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I. Introduction 



Because freshmen entering any institution of high- 
er education have a wide diversity of ability and 
achievement in numerous subject-matter areas, the 
faculty is faced with the probleni of trying to pro- 
vide quality teaching in large introductory courses 
made up of heterogeneous students. One way of 
solving this prDblem is to set up more honiogeneious 
groups by assigning students to courses (and sec- 
tions of course^) consonant with their ability and 
achievement. Such assignment can be best acconn- 
plishcd by using placement and exemption exami^ 
nations. 

Suppose that in addition to trying to "fit" stu- 
dents into appropriate courses, the institution was 
also interested in introducing flexibility into its ed^ 
ucational program by (a) perniitting students to 
graduate in less dme than traditionally required, 
(b) allowing students to obtain credit for knowl^ 
edge acquired outside the classroom, (c) providing 
alternate tracks for students to satisfy course and 
prograni requirements, and (d) through the "re- 
leased tinie ' gained via credit by examinatic^n^ af- 
fording students the opportunity to pursue major 
areas in greater depth, to explore newacadeniicsub^ 
jects, and perhaps to earn a double degree, This kind 
of flexibility calls for institutions of higher education 
to establish placement and exemption prograrns. 

Prior to the publication of Willinghara's ( 1974) 
book, College Plaammt ami Emmption, there was 
very litde formal material to use in developing such 
programs. Willi ngham's purpose in writing Co/lmi 
PldcemeNt and Exemption (CPE) was threefold: (i ) to 
develop a framework that would include the most 
important types of placement and exemption and 
closely related models and to help clarify the re- 
lationships among them, (2) to describe the educa- 
tional rationale and technical charactefistics of these 
models, and ( 3) to review fairly fhoroughly the rele- 
vant research literature. His chief aim was to encour- 
age, on individual canipuses, more systematic analy- 
sis of the objectives and outcomes of these various 
models of sorting students into alternate educational 
treatments. 

Willingham described siK general ways in ^hich 
postsecandary education accommodates individual 



differences, but only one of these — alternate treat- 
ments—was the subject of CPE, Alternate treatments 
were classified into four general areas: assignment, 
placement, selection, and exemption, Using these 
four areas of alternate treatments as a framework, 
Willingham developed 12 models that can be dif 
ferentially placed into each of the four levels, Table 
2 from CPE illustrating the 12 models is presented in 
Figure These four alternate treatment areas 
make up the substantive chapters in CPE, 

Willingham succeeded in his major objective — to 
present an analytic and research oriented review of 
what has been done in the area of placement and 
exemption. However, since CPE is the first book of 
its type, a supplennent is needed to present the prac- 
tical aspects of developing and implementing college 
placement and exemption programs. That is what 
this book is designed to do. To provide maximum 
continuity between this book and CPE, the introduc- 
tions to the placement and exemption chapters in 
CPE are quoted below. 

Placement within a Seqiwnce^ 

"Placement is concerned with a class of alternate 
treatments that has these characteristics: students 
are placed in alternate treatments on the basis of 
competency in specific subject matter; treatments 
vary according to how elementary or advanced the 
subject matter is or at what pace the student is ex- 
pected to master material; achievement at the end of 
the instructional sequence serves as a common cri- 
rcrion to evaluate the performance of students who 
were initially placed at different poinci in the se* 
quence or moved at a different pace, 

"Generally speaking, placement is intended to get 
students started at the right level in a subject ac- 
cording to their preparation and moving at their 
own speed, There are many applications that differ 
from one subject to another; e.g., deciding which 
French course is best for students who Uave had 
varying amounts of high school French, determin- 
ing whether a student is ready to go into calculus, 
ciftering some well prepared chemistry majors a 
speeded first course in chemistry, advising some stu-^ 
dents to take rernedial work in English composition, 
etc, . . . 

1 . Willingham, CpiU Chapter 4. PP^ 59-56, 
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"A commun sense sEnuugy* would bu to ducitk* 
whiit rhe .student ought to know, dt^iurminc svhat he 
already knt5Ws,and tuach him what he needs to know 
as reasoriab!)^ fasf as he can learn it. . . . fHowc^ver, J 
this cnrniTic3[i sense strategy is not so simple as it 
sounds. 

"To decide what the studt-nr oughc to know, it is 
netx^ssary to understand the structure of the subject 
matter and the objectives of instruction. To deter- 
mine what the student already knows, it is necessary 
to cunstruct useful phicement tests that reflect the 
structure of the subject. To teach the stuclent what he 
does not already know, it is nc*cessary to rehite the 
test resulcs directly to the instructional sequence and 
to alternate placement possibilities/' Basically, Wil- 
lingham is sugi^esting that it may be useful to think of 
placemcntasa special form of individualized instruc- 
don where the two may merge ac certain points. 

EKemption from Reqnimnents 
Already Mastered - 

"E^cemption closely resembles placement in the sense 
chat it involves sorting studencs into alternate treat- 
ments on the basis of subjecr matter competency; 
an important difference lies in the nature of the 
treatments. Since placement involves a choice be- 
tween a lon^and a short sequence, student achieve- 
ment in the latter part of the sequence serves as a 
common criterion for evaluating placement deci- 
sions. But in exemption there is no common crite- 
rion; the alternatives represent whether or not a stu- 
dent is obliged to fulfill a requirement, be it a single 
unconnected course or an entire sequence. This 
lack of a comnion criterion means that exemption 
must be evaJuated on the basis of long range consid- 
erations rather than short range achievement gains/' 

In placenient the main concern is to see thac stu- 
dents take up topics thac are appropriate to their 
level of understanding in the particular subject, 

"Exemption, on the other hand, is more a problein 
of determining the conditions under which prior 
learning in other contexts will be recognized. Place- 
ment is an imtriwl tonal strate^^ but exemption is an 
institidtioniit strategy. , . . Exemption is a primary 
means of maintaining articulation between higher 
education programs and other learning." 

2. Willinghani, CPE, Chapter 6, pp. r 32 -33^ 



Purpose ({f^This Book 
ami Its Intimiad Users 

The aim of this book is to provide a general pur= 
pose guide for practitioners to use in deveksping, 
implementing, and evaluating (validating) place- 
ment and exemptic^n programs by ('^) su^esting 
methods of organi'^^ing such programs, (b) suggest- 
ing methods of implementing such programs, (c) 
providing examples of actual working programs, and 
(d) showing how the eKample programs fit within the 
framework of pardcular placement and exemption 
models that are presented in cpn. 

Most of the practical material and procedures for 
implementing the various placement and exemption 
models are usually presented in instituticmal re- 
ports, newsletters, journal articles, professional 
papers, etc. Because there are so many different 
soufces to go tc3 and because institutional publica- 
tions are not easily accessible, this book contains 
examples of this typical material so that potential 
practitioners can benefit from the experiences of 
other progranis, 

The intended users of this book are college and 
school administrators and faculty who are incerested 
in developing placement and eKemption procedures 
and who have no special knowledge of testing or sta- 
tistics. College personnel in institutional research 
and testing should also find this book uieful. For 
more extended discussions of the terminology and 
topics referred to in this book, readers should ac- 
cess Willingham's book. For more extended discus- 
sions of test construction techniques, the follow- 
ing titles*'^ are recommended: 

Ebek R« L, Essentials of Educatkmil MmSummnts, 
and ed. 

Educational Testing Service, Mahing the CldSsmmn 

Test: A Guide for Teachers, 3rd ed. 
Gronlund, N, E., Constrfu'tipig Achievement Tests 
Thorndike* R. L, ed,, EdNcatiorial Measurement 
Travers, R, M. W., How io Make Achievemern Tests 

Finally for more extended discussions of corre- 
lational statistics, reliability and validity techniques^ 
the reader should access: 

C r o n bac h , L . J . , Essen tials of Ps ychobigical Testing . rd 
ed, 

3. Compluce bibliographical informaEion is given in the Refers 
ences, af the end of rhis book. 
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Guilforil, J. P,, ainl iTuchtur, B.» P/nNlupmNtul Sttitis^ 
ScolJe of the Book 

Chapter z ptQ%iinis axfihi srups to follow in implc*- 
muntinM pliiccrnent and uKL^mption activities, incliRU 
ing threes checklists of spcicific activicies, CliaptLTs 
3, 4, and 5 present detailed substantivL' L'xamples of 
the vertical sectioning moduK rlieudvuncud staiuling 
model, aiul the reinetliatbn muduL All thrcu chap- 
cers illusfratL^ the use ()f the eight steps prescMited in 
Cihapter 2. 

All the ejcamplc's and frames (jf reference used in 
discussing the place^rnenf and oxcmpticm models in 
Chapters 3 and 4 ^vere niktn from the programs and 
activities at the Urjiversity of Illinois at Urbana- 
Champaign (Uluch There are several reasons ftjr 
this: first, the placement and exumption programs 
and activitit'S ar^ quite cornprt'hensive and represent 
cative of those ^it ocher institutions both large and 
snialL Second j bocli locally developed and commer- 
cially developed eJcaminatiuns are used in the pro- 
grams. Third, because the author was instrumental 
in the development of chosu prognims at the uiuc:, 
it %vas possible to provide much more detailed exam-' 
pies of the placemL^nc mA coemption models than 
would have been possible otherwise. 

To provide a snriaII<ollege perspective, the exam- 
ple of placenfienf for remediiicion discussed in Chap- 
ter 5 was taken frofn the activities of Wesley College. 

Finally, Chapter 5 offers a few brief thoughts and 
siiggestionson hovv to assess and plan for placeinent 
and exemption activities^ 
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2. Developing, hriplementing, 
and Evaluating Placement 
and Exemption Programs 

T\m chapter presents ei^lit steps to follow in order 
tc) develop, inipk*ment and ej^perim en tally evaluate 
pliiceriiunt and exemption pro/^rams at a cullcge. 

STEP I: Defuw th P/irposts uf 
PUicemefJt and Exe^^/pllon 

In ^levelopin^ placement and c^xemprion activities 
on a campus, one of the first cancerns should be a 
clearcut definition ()f yourgoals, 

Sarii^j^ Si//(/ep!ts niio Secthns 
A major considCTation at any college is how to deal 
with the wide diversity of the students enrolled in 
the introductory and required courses. There is usu- 
ally such a wide range of ability, interest, and previ- 
ous preparation that many instructors are forced to 
direct their instruction at the students in the middlei 
thereby boring the more able scudents and fruscrat' 
inj^ the less able. If it is possible to devise or find a 
measure that allows the instructor to better define 
and group these diverse studencSi then more homo- 
geneous secticjns of the course can be created, pro- 
viding a less fruscrating climate for the student to 
learn in and for die instructor to teach in. 

Hi/phi Pmhmm Select Approprhite Course Leve/s 
Students beginning their college careers have had 
varying levels of course e^cperiences in secondary 
schooL Some may have taken college preparatc?ry 
courses and read a great deal c^n their own, while 
others may have performed >A^ell in courses which 
would be judged inferior to similar remedial courses 
at the college level, If the institution is interested in 
helping freshmen students begin their learning at 
the appropriate place and level, then developing 
tests that could be used to guide them is an impor- 
tant first step. Such examinations not only help stu- 
dents and advisors to select appropriate courses and 
course levels but also result in more student satis- 
faction and less ftuscration in the initial college 



coiiJSe experiences. Course work bec^)meJ more 
relevanctD 3mderitneds,andsctideritsare no longer 
required to tal<e pres^equisice courses regardless of 
cheif previous jpr^paradc^n arad expej iences. 

He/phi g A dva pued Stsitie^its Mom A hmd 
If tile instituticn is interested in prcmating a tirn^ 
V shoftencci cJe^ice progr^ni or allowing itudents to 
rnove into inoce adva^nwd courses based upon their 
present capabiliti^sahcn aplacenientandescejnpti^n 
proigrann is very likely in order, Such a pfogr^ni 
migliE aJso be inc^rpjret^d toth as a move to indi- 
vidualize instruction by allowing students easier 
die t^s^ to more appropriate cQUrSes early inttmeirc^l^ 
lege careers and as a tmm^ eo encourage tJe d ^veloP- 
mentor eKCellenceat an earlier period iii the ^'olle^je 
career. 

What CDWrses c7f course s^equences are to be in- 
cluded in your pl^cefaier^t arad exenripti&n pr^jgrarn? 
At& they co be the large iratroductory courses for 
beginning scuderits are they co be advanct'd 
coujses for cc^nfiriuiQg ^nd tra.nsfer stiidencs? rhe 
final decision about which courses are to be in- 
cluded in a. pl^ceiHen tarid exertipti^n pjogrtni yw'ill 
depend upon th^ irastitutians ne^ds, the appro- 
priateness of ttiecourse^iandthecaoperatioriof rlie 
responsible fac ulty ati^J d ^'partiaentaJ sta^. 

A Word of Cdi^ikfi 

The results or pl^ceniierit and exernption e^amiria^ 
tioiis are ofteii misused guar^nte c a cwaii^ nuiii' 
ber of course sectior^ss ^nd teachiaj assistant posi- 
tions, LJsin^ e5<air^in^tiora vvhich was dcvdop^'d 
CO determifie diferermt levels of cortipec^ncy^ wlthsin 
a paiticular course sequeiice merely^ to ensur^equal 
numbers of stiidefits in each course of the st^ciuerxce 
invalidates che purpos-co/theeKamination. 

STEP 2: Demmin^ ths Mufcr 
TnstYiictiomf O^jecJii/S! o/t/je Co/irje 
o f Co/ffse SecfiierM 

Once you have decided ^vhich course or course ^e* 
quence is to iticlu^led in this placeni^tit and 
emption progfam, those responsible for the course 
c?r course fequerice need m determiiie what tlie 
iTiajoriristriJcticnaJobjectiveaarein tefrr^iof theje- 
partnentj college, and iifiiversity eKpeccatiom F^)r 



exwnple, is the course or c^jurae peqiience desijne<l 
as clie foundatiofi for student coimpetencies in other 
coariesor course sequences \e\ ttiedcpa-ftmcn«an<l 
College, oris it desigrid to ensure accmjpecency 
level in ancl of itself ? Whar are the arriouJit and typ^e 
of niaceriaJ to be covered ^nd what are instructors' 
exp ectadofis ^ith regard tc^ students' capabilities iJi 
usirag ^hat w^as learned? ^hat sMls is the course 
maceri^l deiigned to develop at either th« cogriitiv e 
or a^ffective lem'l? 

T^here are several good resD*urc€s cc use in tryinj 
to define the majar ifistr"yction0l Dljectisres of a 
coiijse or coiirse segueiice; Blcor*^, T^/^'c?^^5/^^Jq/E^^ 
ucaMimal Objmiwes <i9 36)^ Krath^ohli Bloom ^an-d 
Masia, Ta^ucmy of Uduc^ihml Obfmims (1^)64.), 
Mager^ Preparing lnJtrr^nia^i(^l Obfictfm (\^)^i)^m^ 
Gronlund^ Staling Behavjof^^il Obje^^iiv^s for CJassroo^i 

STEP 3: Seaire or Deve/op m AdiqmireT^sr 

With instructionaJ otjectiv^s defined* the next stef 
is to deterriiirxe w^hac types ^f c^st# are needed code- 
terrain e siiCceiSi failure, le^vels^ of achievemenc^etC. 
The measures needed may be in che tforiiiof objeC' 
tive ex^miciations, e^sa/ ex^nniEiations^oraleacariiin*^ 
tion=Si perfcrriiarice cxainir^ations^ portfolio ev^^lu^- 
tioixSj etc, lor eicamples of jiPerePt kinds of ejcanni' 
mticnsiSeeA.Jearxioni(xy6fl)^ 

Tie type of in€as\ires needed depends upon th^ 
xnai*! purpose of the measi^remefit Far exaraple, to 
plac e students withijn a sequence of courses, a tes-t 
^viiicli fits each course in th^^rqu^nce is needed, "to 
jrar>i( "edi t for general edi^cacioasl requi rements, 
test represeniing commor^ly accepted courses in 
jnarsy colleges across the ^ouintry^ is needed, If, ifi 
^dditioiii the rueasures for placement and credit ar£ 
deeded for advising purjos^^ prior to course enfolt* 
Jiiermtj chen the test scores should be availabJe early 
^noiJgb for advisors ancl st^de nts to use. The need 
/or jTiofe clan one fornn of an e^cami siation anci ar- 
/anting security may also be imporcanc considera.- 
tioriis, 

O^nce yoiiliave determined ^hat type of measure 
is needed, you rnusc ascertain if #ucK a neasure i5 
available froirt a test pullisher. Below is achecklist 

a<tivitie3 to help yo\i select appropriate in^tru- 
^Tierfcti for c onside ration. 



CheMlu fbr I dm Mfy hig dri^ 
Selecting PMf/jheJ imtrMiimts 

I, Identify jotencial iiistr'uinffnts: 

^a. Using BufDs' Mm Ml MimnfenmHs Ymrbooks 
{MHS) arid Tms in frifal, learr* ^hat tests are avail- 
able ^nd read critical revie^i of them by experts. 

=.b^ Gather ^nd irispect ctoJ ogs and announce- 
fmencs for references »n tests^, services, and tech- 
nical dac^ froni test paibliphejs such as The Col- 
l^|e Board; Ha^iCoUrt Brace Jov^movich Inc.; Sci- 
ence Research Asoda tes; etc- 

.^.c. Read the professioranl publications of the Na- 
tionaJ C^3U5cil on UeMixri^m mz in Education — 
AfmsMn^mf N^u^j and the" JojimaJ of Educational 
/^ms^iremmt -fcr ana ouncen^ents of new tests 
arid lists of tm review^sas wJl as general articles 
on ce£tin£ issues. 
_^d. If tesc security is indportarmti determine which 

publishers provide app ^opr iate securi ty . 
_.-=e. If moxe f hari one fofm of an examination is 
needed, determine which p ubiishers provide such 
a service. 

_^f If you iiee^d co try out the ^est on a sample or 
ccp^ursc be^foredetefmir^ing its appropriateness, in- 
ve-srigate fhe test publisher s policies concerning 
trial aJminiscrations. 
Se"lect instrurnents for closer scrutiny : 

__a. Serid Tor specirtien sets Csaci^ipJe copies) of the 
re^ts selectecJ \n order to an^ly^e the questions 
andthejnaterial cDverediri depth. 
^_^b. Have the individuals ffsponsible far rhe course 
or course- seque-nce de tern^ine which tests most 
clmtdy rnatch cho te.^ting ancl/ar inHcructional 
objeccive^^ 



After careful research of publiihed tests, you may 
decide that the course of course le^uence concaini 
too many unique elemetits aad requires the develop- 
ment of a special nieasure Belo"^ ai a checklist of 
activities to help you. 

Checklist for Developing Imtmmm^s 
„ I, In order to identify the appropriate contencfor 
the test, begin by specifying tKeijiscructional ob^ 
jectives to be tested. 

Construct a table of spedfications ortestbJue- 
print incorporating thefollovvia^elernencs: 

The specific 'content areM"-- the important 
things a person who has studied the subject is 
expected to know. 
_b. The intellectual skills required. 
_c. The total number of questions to be asked. 
„d. The number of questims needed in each 
contenc/skill categDry to represent its relacive 
importance. 

An example of a test blueprinc used to conscruct a 

Chemistry Exaniination is presented in Figure 2.1 . 
Identify the individiials ^h.0 will write the 
questions and the material they are to use. 

_4= Determine the types of questions (muJdple- 
choice^ essay, true=false, etc.) to be used for the 
test. To Some extent, the subfectiriatterv^ill influ- 
ence the choice of question fornna^ (type). For ex- 
ampler in a test of a student's raiaj^reading sicills 
the use of maps in thequescioiii is necessary, 

„5. Decide on How diffictjlt the quesdons in t\m 
test should be. For emmple, should the ques- 



pigure 2, f . Anex^^mplc of ar^'^t blueprint for construct I ng a chemistry examination 



AummicScm'ctjfe . , . , . , 
C liemical Bc)n<iin^, . , . . , 
Scutes of Martyr. . . ... . 

Scoichiomctry * , . - , . 
E^iergedcs in ChernicalSysterais . 



Skil/s 



Definitinn nf Basic 
ofTichfthil Siieniific 
fermi PritnipliS 



5 
5 
5 
3 
5 



of Qf/aih 

3 

3 

3 
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lions be aimed only at the minimally qualified 
sciidents or spread over the full range of qualified 
studeafs? 
^ 6. Prepare the questions. 

_ 7. Have the questions edited by sonieone other 

than the^ficers* 
„ 8. Have the questions independently reviewed 

by other cofnpetent colleagues. 
„ Q^Rewite the questions based upon the results 

of itenis 7 md 8. 
„ E 0. Prepare a scoring key or procedu re. 
See j^ppenciik A for an illustracion of some of the 
consiclerations in developing an inscrunient locally, 
in this case a Calculus EKeniption Ejcaminatioii. 

Along witd the checklists of activiries to either 
select or develop the appropriate instrurnencs, you 
need to sat up a- tirtietable. The length of the time- 
table depends upon the type and extent of the 
checklist developed as well as the number and type 
of persoaneJ available to acconnplish the task. Allow 
enough time For each activity to be accomplished as 
well as a litcle c^ctra cushion of time (approximately 
10 percent) for unexpected delays. Be sure rhac the 
responsibiliciea of the individuals involved are 
clearly de^aed and that each is aware of all timetable 
deadlines (e^^cludingthe cushion portion). 

STEP 4: ^etemii/ie the Reliability and 
Validiiy ofth Instruments 

Once the in^trufnents have been selected or devel- 
oped, ic is necessary to establish procedures for de^ 
termining their jeliability and validiry (which are 
useful in judging the quality of a measuring instru- 
ment). Belia^biJity refers to the degree to which a 
measuring iristrunient is accurate or free from error. 
For exaniple, a perfecdy reliable test would yield 
the sanne sccre for a student if the test were re^ 
administeredl ca the student (assuming no effects 
frorn ad ditianaJ learning, practice, etc.). 

Estim^iting B^idia hility 

Unfoftunately^ tliere is no direct way of deter niining 
reliability by discovering what propordon of a mea^ 
suring instriiment's scores are free from error. 
There are, however, various nriechods of arriving at 
estimates of reliability, most of which involve com- 
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pariions of tw^o scores for all the individuals intsonie 
defined group, fhe degree of relationship between 
the two sets of scores is expressed in terms of a cor- 
relation coefficient which can range froxn +1,00 (in- 
dicating perfect agreem en tor no error) through .00 
(indicating no aireement or complete error) to 
--i.oo (indicating perfect disagreemeiit and no 
error). Instrurn&nta dewloped for classroom use 
typically have reliability coefficients ranging from 
.40 CO .80. The three xnoic cornrnon methods for es- 
timating reliabilit)' are (a) an internal analysis of the 
rest scores obcairaed by using the test once, ( b) a cor- 
relation of the scores from two fofnis of the test 
given at about th^same tiriie, and (c) acorrelacion of 
the scores betwen acescand recestatalater time. 

Types of Vat iddiy 

Validity refers t^ the esteiit to which a test is mea- 
suring what ic is supposed to measure, which as- 
sumes that one can determine what the test does 
measure. Logical validation is concerned vvich the 
question "What does the test measure?" and em- 
pirical validation is coricerned with the question *To 
what extent does the test naeasure what it is sup- 
posed to meastire?" Before identifying the different 
types of logical and empirical validation procedures, 
it is worth emphasisirii that different validation ap- 
proaches may he appropriate in different situations, 
Five separate ryp^s of validity are described, one in 
the logical area an^d four in the empirical area, 

1, A logical vajiualioii r^q uire^ JudgnieuL on the 
"content validity " of the test. In other w^ords.do the 
nuestions and focniat of the test correspond to the 
instructional objectives of the course? This judg- 
rnent is most apprc^priately rTiade by experts in the 
content area (i..e, iastructori). Content validatiori is 
always issMia! in the develop inent of any placement 
or exemptioti pro^rani since che tests will be used to 
reflect course and sequence ouccomes. In addition, 
since many colleges may not have access to test and 
measurement specialists, content validacion inay be 
the only type of validation that they can undertake, 

2. One type of empiricaJ validation is the "com- 
parison of the t&st icorcs of scudents conriplecing 
successive cours&s in a sequence" (e.g., first, sec- 
ond, thirdi arid foufth semesters of French) to deter- 
mine if the teir ca.ncjistiri|uish between the courses* 
This type of validity, howver^ applies only to a 
series of courses En ^hich generally similar content 
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is included throughout the series so chat it is rea- 
sonable CO cover all char material in one test. This 
method would not apply to a series of counes in 
mathematics, for example, where each course cov- 
ered a different topic. 

3- A second type of empirical validation is the 
*'rtieasure of student gain in achievement after cak- 
ing a relevant course." This is a more generally ap- 
plicable method of validation than (2) above, but re- 
quires tescing both before the course starts and after 
the course ends. The gain should be much more sub- 
stantial in a pUcement tesc that closely corresponds 
to a specific local course chan in an exemption test in 
^ parciculsr subjigCE arc3. 

4. A third type of empirical validation, called "ex- 
perimental,*' refers to the results of trait-creatrnenr 
interaction studies. The primary purpose of such 
sEudies is to identify students ^ho will perforni dif- 
ferently in alternate treacmencs. This cype of valida- 
cion is likely to be of interest only to experienced 
researchers, ^ho should refer to the discussion in 
CPE (pp. £0-1 6^ a8-3t) for more specific information. 

5, The fourth and possibly weakest type of empiri- 
cal validation is called *'concurrent validation.'* This 
js typically expressed as a relationship between test 
perforiTiance and an accepted concemporary criterion 
(Ic correlation bet-ween course grades and test 
icores obtained at the end of instruction). If a test 
closely corresponds to the content of a course, it 
wuld be expected to have a riiore substantial cor- 
relation with final gr:ades in that course^ but, at the 
same time, if the instruction is effectively carried 
out and if many scudencs master the material then 
the correlation would be depressed, perhaps sub- 
stancially, because the range of student performance 
%vould be very restricted. Coniequently, one is left 
not knowing 'what to eKpect other than the fact that 
a concurrent vahdity coefficient will frequently lie 
in the mid-range of ,40 to .60. 

Although five types of validity h^ve been de> 
scribed, all inftitutions should conduct concent 
validation on the examination to be used, Institu- 
tions should accempc to gather further empirical 
evidence as soon as possible in order to evaluate the 
appropriateness of the examination. 

Test publishers usually report the reliability and 
validity data in their test manual or interpretation 
information. If you do not find such data reported, 
be prepared to conduct your ov^n experimental ad- 
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ministration of the instrument following the proce- 
dures ouclined below. Do not assurne that a particu- 
lar test is either viUd or reliable simply because it is 
marketed by a test publisher unless evidence of 
either or both is provided, When such evidence is 
presented be sure to check the characteristics of the 
groups used to generate the evidence to see if they 
are comparable to your own student group. 

Conducting a Pilot Study 

A pilot study, or experiinental administration of the 
instrument, usually precedes the actual use of the in- 
strumenc. In setting up experimental administra- 
£ion5 you iu use det#riaine^ first, what is che ApprO' 
priate group to be tested^ and second, how large and 
represencacive the sample of this group should be. 
One of the types of empirical validation requires 
giving the tests in the beginning of a course or course 
sequence and again at the end. Ideally, parallel test 
forms should be used. If the test measures what is 
being taught, and if, on the average, studerits learn, 
there should be a significant gain in performance, 
Moreover, scores on the post^test should correlate 
positively with course grades, 

The next step 11 to decide on who will be respon- 
sible for providing the test materials, administering 
the tests, collecting the responses* and analyzing the 
data, Before the data are analyzed, you must agree 
on what will be regarded as providing acceptable re- 
liability and validity evidence (rarely for a placement 
or exemption test is a value lower than ,80 chosen 
for reliability and a value lower than .30 for validity). 

After establishing the procedure for determining 
the reliability and validity of the instruments^ you 
need to consider the rnethods of reporting those 
results for discusiion and decision making. If the 
individuals who are to make the decisions about the 
"acceptable" reliability and validity evidence are the 
instructors who teach the courses, chances are they 
have little knowledge of measurement and statistics. 
In that case, a great deal of graphic material should 
be presented along with nontechnical explanations. 
Try to present the evidence by using simple dia- 
grams such as score distributions on a common scale. 
Ideally, the individuals who should be involved in 
this process are the teaching faculty, a departmencal 
decision maker, and an instructional research or re- 
source person. 

When presenring the results, have all the available 
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data on handi including theindiv'idual student scores. 
It is better to have more inforniation than is re^ 
auired than to arouse suspicions that soniething is 
beiag ^'withheld." Even though the faculty and de- 
partrnental representacivea are che ones making the 
fin^l decisions about the appropriateness of the mea- 
sure used, it is a good idea to have some tentative 
interpretations and suggestions prepared for their 
consideration. Many times this w^ill save niuch wasted 
effort and help to focus on the nnain problem of con^ 
cern, 

STEP 5: Detmnim Decisim Scores 

probably one of the most important judgmencs cori* 
cerniag the placement and wemption measures to 
be used is what the decisioti scores (or cutting 
scores) should be. Technically the decision scores 
should be a logical consequence of che validity stud- 
ies, discussed above. For exartiple, when a new seia- 
dent is given the test as an ejcemption examination, 
his being granted credit is concingent upon where 
his test score ranks compared co the scores of stu- 
dents who have completed the course or course se- 
quence. Similarly, pUcemencisalso contingent upon 
a certain level of tesc perforfiiance compared to that 
of students who have completed the course or course 
sequence. Typically, this means pcrfornicince equal 
to or betf CT than C students. 

Before setting decision scores, you must be cogni- 
zant of such essential Concern s 3s (a) how pEtcicular 
decision scores relate to grades earned in relevant 
courses, (b) how many studeno %vould be eKempted 
froiTi the relevant course^ (c) wh^i grade and score 
would be considered *'passing/'{d) whether the deci- 
sion scores shouid be s^t at a CDfiservative or liberal 
level, (e) whether there is a fisced quota of students 
that can be accommodated in a particular course or 
course sequence, etc. 

Moreover, you should be aware of some of the 
consequences of using a particular decision store, 
for example, (a) students would be discouraged from 
attending the institution, (b> too many students 
would be exempted from a basic course sequence 
resulting in fewer majors in chat area, (c) students 
would gain too much credit for coursework result- 
ing in decreased funding for the institutions, (d) the 
students who are exempted frcnn the first course in 
a sequence would not have the requisite skills for 



the second, (e) faculty loads would be aff'ected in a 
detrimental way, etc. 

In light of these concerns, the checklist below is 
intended to help you arrive at appropriate decision 
scores, 

Ch^cA/tsf for Detirminmg Decisio^i Scons 

_ I, Prepare the validity data (eg., how the test 
scores and course grades are related) in an easily 
^readable and interpretable format. 

_ 2. Prepare appropriate graphic material for the 
v^aridity data, 

, ^3, Provide a preliminary draft of che validity data 

CO the faculty and departmental representatives 
at least one week before they meet to discuss the 
decision scores. 

_4, Ac the meeting, present the data orally and 
discuss it 

„5.Have the actual data used in the validity study 
available for perusal at the meeting. 

Determine the minimum acceptable grade (or 
range of grades) for each decision score. 

Surest the proposed decision scores based 
Lipon the information and data in the steps above. 

Indicate how many students would be ck- 
empted fronn (or placed in or given credit for) the 
relevant course based upon the proposed dect* 
sion Scores. 

Discuss the implications (consequences) of 
adopting the proposed (or other) decision scores, 
=^ I 0- Dsteritiine if another meeting' needed or if 
all are prepared to agree on a set of decision 
scores, 

_ 1 1^ After an agreement has been reached on th^ 
decision scores have each member of the com* 
rnictee acknowledge it in writing. 
„i a. Inform the appropriate individuals and groups 
of che agreed upon decision scores, 

STEP 6: Arrange for Rout im Adm'mht^^ 

After thcj instruments and their corresponding deci- 
sion scores have been selected, methods rangimg 
froffi administering through reporting the results of 
the testing need to be establislied. For example, who 
is to be responsible for ordering or producing the 
test inacerials ^ a central testing office, or the depart^ 
ment, college, etc.? Who is to be responsible for 
scheduling the time and place of the testing, espe- 
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cialJy if special rooins are needed at special times? 
Who is to be responsible for adrninistering the tests 
and coUectinj the materials the instructor, a test- 
ing person? The answers to many of these quesdons 
depend upon whether or not there is a cenrral testing 
office in the institution and what the budget of that 
office or of the relevant department is for testing 
fieeds. 

Methods will have to be set up for handling the 
teit results after they are collected. Who will do the 
actual scorinj---clerlcs* students^ optical scanners^ 
conipurerSi etc.? Is there a coniputtr program or 
formm for reporcing the test results? Once the re- 
sults are produced, 'will they be recorded on the 
SCUueiii S peiiaaucui itrcuiu; if ^u^ how wiii this be 
done? Will the results be provided to the students, 
ndvisorSi etc,? Will interpretive information be pro- 
vided to both the student and the adviior §o that in- 
telligent use can be jmade of the results? 

One way to help students make ma^cimuin use of 
their rest results is to provide then^ with a means of 
progranimed self- ad vising. Examples of just luch a 
iystem are preserited in Figures 2.2 and 2.3. Figure 
a.2 shows an e%afiiple of the University of Illinois 
at Urbana-Champai^n (UIUC) Placernent and Pro- 
jficie ncy Test rQBiihs form. Figure 2.3 is an ejccerpt 
ftoni the VWC Student Self-Counseling Manual 
(Qilbert and E'Wiiig, 1968)* which sho^i how to 
interpret the test results and make up a course 
schedule for the first semester and posiibly beyond. 

In obtaining and pfesenting test result infornia- 
cion such as that presented in Figure 2.2 an impor- 
t^nt consideration is whether any comparative data 
should be gathered and presented. To answer such 
0. question* you must determine whether compara- 
tive data are needed and useful In other words* 
whecher such data would affect the decisions made 
on the basis of the test results. If you decide to pw- 
vide comparative data, you must detertnine whoche 
comparative group should be and when the cotn- 
paracive measures should be taken. Generally, such 
CQfiiparative data are used to establish norms by 
which individuals in later groups can be judged quah 
ifatively. Therefore, one must also determine how 
the conipariions are to be reported. In Figure 2.2, 
cofJiparatsvt data are provided by nieans of deciles 
twinging fronn o to 9 indicating how each student*! 
score compares to scores of students the previous 
year in the same college as well as in the university. 



Finally^ it is important to realize that whatever the 
decision scores used, sonne misplacements will be 
madei especially for those within one or two points 
of the decision scores. Therefore, advisori and in- 
structors alike should be alerted to the fact that cer- 
tain individuals may need to be either placed back 
or placed fofw^ard depending upon their perform- 
ance in the first two weeks of the courje. 

STEP 7: Develop an Evaluation Plan 

After going chrough all the trouble of seffring up a 
placement and exemption program, you must be 
sure to develop the methods of evaluating how well 
the program is 'working arid specifying when unA by 
whom follow-up data will need to gatheired. Sup- 
pose, for e^cannple, that a placement ^xafnination was 
designed to place competent freshmcTn into a calcu- 
lus coufse* The follow-up data needed to determine 
efFectiveness rnighc be how many of che students 
completed the calculus course and ho'w they per- 
formed compared to the rest of the cla;s5. If this is 
the first year using the placement examination and 
if the same final examination was used in the pre» 
vious years course, a comparison of the calculus 
class results between the two years would be im- 
portant. It is suggested that ynu do not use the end- 
of'course grades in this comparison because they are 
notoriously lubjecf to unconscious gmding varia- 
tions that can be quite substantial in mmxiy cajes, It is 
preferable to ii§e a common examination (whatever 
the type) across several secrions of the course% mak- 
ing sure that it is rated blind so that the readers are 
not aware of which section a stadens has corne from. 
Another method of evaluating the effectiveness of 
the activity is to gather attitudinal information from 
both the students and the faculty who are aflfected 
by the prograrri. If it is possible to gather attitudinal 
information before the program initiated and 
after, that would be even more useful 

Finally, it is necessary to gather evaluative infor- 
mation that might be used to rectify placement mis- 
takes. For example, systematic rrcQrding of place- 
ments that have to be changed early in a term 
because the student or an instructor realised that 
the student was simply in the wrong section can be 
used either to adjust decision scores or alert ad- 
visors to potential problems. 

In these fiscally lean days for higher education, 
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Figure 2.2. The UilJC's Placement and Proficiency Test Results Form 
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FiguTU J, 3, Sample incerpretatiufi sheet from the Uiuc: Student Self-Counseling Manual 
to be used with the Test Results Form 

STUDENT BOOKLET 

This booklet is Co be used in conjunction with the Self-Counseling Manual. 

Host of the cast scorea feported on the test cards on page 2 compare you with 
other entering atudrnts at the University of Illinois by means of decile icores. 
These decile scores are to be used chroughout your reading of the Self-Counieling 
Manual, and It la important that you clearly understanu cfttair meaning. A aeciie 
score is computed by dividing Into tenths the group of students with whom you are 
compared* The highest decile (9) Includes the 10 percant of students with the 
highest scores* What each decile score means is Qdscribed belowp 



Read this carefully! 



Pec lie Score As _gompared with ot hef_ students your sco re ist 



9 Among the highest 10% (Better than 90%) 

8 Better than between 80% and 90% 

7 Better than between 70% and 80% 

6 Better than between 60% and 70% 

5 Among the 10% Just above average (Better than 

between 50% and 60%) 

4 Among the 10% just below average (Better than 

between 40% and 50%) 
3 Better than between 30% and 40% 

2 Better than between 20% and 301 

I Better than hptrween 10% and 20% 

0 Among the lowest 101 



Your ab^ 1 L ty interes 1 1 and jlaCg^gnt ^e^st results 

Carefully eMmlne the cast results provided here. In order to be certain 
that you correctly Identify the meaning of each teat scores you are Co copy the 
decile score for each test onto the opposite page* As you copy each score, read 
the definition of that score on the opposite page* 

Where both "College" and **A11-Unlv*" deciles are given, copy the "College" 
deciles which compare your score In each case with the scores of other students 
entering the college you plan to enter. 



Copy your test scores onto che opposite 
page and read carefully the description 
of the meaning of each test score* 
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any assessment of an educational product nnust deal 
with such questions as (a) what is the cost of the 
program? (b) what is the cost of the instruction? and 
(c) is there a cost advantage (benefit) for placennent 
or e%ernption activities? In a recent article on how 
such a cost/benefit analysis might be conducted 
(Stallings, Aleamonl, and Heil, 197a), examination 
costs were categorized by test administration; test 
processings analysis, and dissemination; and data 
processing. Then the examination costs were divided 
by the number of examination credit hours, yielding 
a figure of S7.Q9 per examination credit hour, This 
figure was then contrasted with an unofficial instruc- 
tional cost of $15,18 per credit hour for lower divi- 
.^inn undergraduate courses. With such information 
available, you are in a much better position to argue 
for or against the continuation of such activities. 

STEP 8: Develop a Procedure f or Periodic 
Review and Modification 

An important final step in implementing a place- 
ment and eKemption program is the process of per- 
iodic review and modification of the policies agreed 
upon. The academic department is clearly the first 
link in the decision-making chain concerning the es- 
tablishment nf policies regarding such activities re- 
laced to its courses. College and university repre- 
sentatives should be involved to the degree that the 
policies affect them. The department should deter- 
mine, if not be instrumental in desienating, which 
committees or offices need to be involved ill estab- 
lishing the policies. For example, a placement and 
exemption policy that will affect students in all col- 
leges of the uriiversity should be broughc up to a 
committee of representatives from each college. 

Because the pattern of entering students' prepara- 
tion, abilities, and interests is subject to change and 
because courses are subject to change, policies 
should be reviewed every year, and formal revalida- 
tion of examinations should take place at least every 
three years. Although the final responsibility of ini- 
tiating a modification of policies rests with the de- 
parEment concerned, the individual, agency, or office 
responsible for administering and conducting the 
studies should be responsible for alerting the de- 
partment about needed modifications. 



EKLC 



3^ Design and Validatim 
of a Placement Model: 
Vertical Sectioning 
in Foreign Langmge Courses 

This chapter describes how one of the CPE place- 
ment models ^ Model 3 ; Vertical Sectioning ^ can be 
used to assign entering freshmen to courses (and 
sections of courses) that fit their diverse abilities and 
achievements. A detailed substantive example then 
illustrates the eight steps presented in Chapter 2. 

Placement has been defined iri CPE as the posi^ 
tioning of students at the optimal point in an instruct 
tiorial sequence on the basis of how ruiich the stu- 
dent knows about the subject Plac'emefit therefore 
depends on the results of various subject-niatter 
tests. Treatments (courses or sections) vary accord- 
ing to how elementary or advanced the sub ject rnat- 
ter is or at what pace the student is ^jcpected to mas- 
ter the material^ but they always h^ve a comition 
subject-matter criterion at the end of the sequence. 
The general purpose of placement is to match the 
content of instrucfiori with what the student needs 
to learn nesct. 

Vertical sectioning^ the placing of a student at an 
appropriate point within a course sequence, involves 
two decisions: ( i) what is the most appropriate point 
of entry within a sequence for a particular student, 
and (2) whether to waive prerequisite courses in the 
sequence. Five foreign language dep^rtnients at the 
University of Illinois at IJrbana-Champaign (UlUC) 
use examinations for placement and exemption deci- 
sions in their introduccory courses, This program 
provides an excellent example of Vfrtical sectioning 
which involves placing students at appropriate 
points within a course sequence. It alio provides an 
example of how examinations can be used for both 
placement and exemption. 

Here is how the eight steps presented in Chapter 2 
were followed in implementing the foreign language 
placement and exeniption program the UlUC- 




SIEPl: Piirposeof Placmmt 
and Exemption 

Representatives of the Measurement and Research 
Division (MARD) of the Office of Instructional Re- 
sources at the UIUC approached the departnients of 
French, German, Latin, Russian* and Spanish about 
developing a placement and exemption examination 
program. Each of these foreign languages has a 
basic two-year sequence which also serves m the 
foreign language requirement of the UIUC and in 
particular is required for all Liberal Arts and Sci- 
ences (LAS) students. Students who have taken four 
years of one language in high school, however, are 
eKempted from the foreign language requiremenr 
because it is assumed that those four years would be 
equivalent to four semesters of UIUC college foreign 
language. This assuniption was then generalized to 
an advisory policy which assumed that one high 
school year was equal to one college semester of 
work. It was uncertainty about this assumption plus 
a desire on the part of the foreign language teaching 
faculty to honiogeni^e the varying ability levels in 
their introductory courses that made them receptive 
to a proposal to develop a placement and exemptiori 
( p/e) system. The foreign language departments also 
felt that such a system might encourage more stu* 
dents to consider foreign language as a major by 
recogniEing their previous equivalent performance 
and placing them at a more appropriate level of 

W M 1 -3 W ^ 4 K P 

A committee made up of one representative from 
each of the five foreign languages and c>ne LAS col- 
lege representative was designated to work with a 
representative of MARD in developing a P/E pro- 
gram. This committee was empowered by the de- 
partments and colleges to make all final decisions 
concerning the establishment and implementation 
of the prograin. 

STEP 2: Major Instructional Objectives 

The committee specified the first four semesters of 
coursework with the common numbers of lOi, 102, 
103, and 104 to be the objects of the P/E program. 
They further specified that the foreign language 
competencies of knowledge and application of read- 
ing, writing, speaking, and listening skills taught by 
these courses were appropriate but that students 
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could also demonstrate these competencies by eK- 
amination. They felt that the examinacions and eval* 
uations currently used in these courses reflected the 
instructor* college, department, and university ob- 
jectives for foreign language learning, and there- 
fore agreed that students' grades based upon these 
measures would be an accurate cricerion measure* 
That measure could then be used to make judg- 
ments about both placement and exemption, 

STEPS: Test to Be Used 

After considerable discussion, and after considering 
the results of an earlier study in this area (Aleamoni 

types of examinations in combination for the P/E 
program: an objecdvely scored reading rest, and an 
objectively scored listening test. It was decided that 
these examinations would be secured from a test 
publisher rather than developed on campus. 

The Checklist for Identifying and Selecting Pub- 
lished Instruments was employed in the following 
manner: The mard representative investigated the 
tests in Euros' Mental Measurements Yearbooks* 
catalogs and announcements from the major test 
publishers, and Memi^rement News and the JoNrMal of 
Eeluciitmial Mmsi/reme^ii, and identified several in- 
struments as possibilities. After discussing these 
tests and the descriptive material provided by the 
MARD representative, the committee decided that 
iliey wanted the test publisher to provide some 
guarantee of security so that once used, the test 
questions would not be easily available to all pos- 
sible test takers, In addition to test security, the 
committee decided that multiple forms of the ex- 
amination would be needed to avoid giving the same 
form every year. With these considerations in mind, 
the Committee requested copies of the College 
Board's placement tests in both Reading and Listen- 
ing for French, German, Russian, and Spanish, and 
for Reading only in Latin, for a more careful inspec- 
tion,' The specimen set cc?pies were reviewed care- 



I, Those tests are rL-tired farms of the Achicvemenc Tysts of the 
College Board Admissions Testing Prograni and are available 
through Testing Academic Achievement, a program that rnakes 
available subject mattcT examinations for administrarjon by in- 
scitutions. For further information see Testiuji, Acatiemk Acbieie- 
mtNt. College Board Publications Order Office, Box aHri, 
Princeton, New Jersey 0854 1 - 
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Figure 3, i . Su^ested procedures for providing sufficient student morivatinn in examination validation. 
Measuraraent and Reiearch Division - Office of Instructional Resources 



Placemant PrQflcleac7 Examination Valldatloni Student Motivation 

k major componaiit of the validatioii procedure Is based upon the 
administration of the P&P eKaminatlon to students at all levels of the 
appiropriata coursa sequence at or near the cQSipletion of a course. It 
is assumad than that the resulting PStP test scores reflect the students' 
abilities at the completion of the course; the abilities of entering 
freshman are then compared with these '^flnal^' abilities to decide on 
proper placemant and proficiency. 

For this approach to produce valid resulta. It 1^ ffsg?ntial that 
the students involved in the validation testing be motivated to do 
well on the test* That iSs the validation test scores will not reflect 
the students' actual abilities unless adequate motivation is present. 

The only approach vrhlch has proven to be effective in providing 

sufficient motivationj thus far, is making the students' final grade 

dependants to a certain degree, on their P^P test scores obtained dur^ 
ing the validation testing* 

Various other approachas to this motivation problem have been at- 
tempted by the Measureraent and Research Division (MARD) staff In recent 
validations. For exaiaplaj students in one dapartineiit were told that 
their honest effort was needed to help the department make better P&P 
decisions in the future. Students in another department were told that 
the test score would count toward their grades If the grade was "border-- 
line," The data from both of these later approaches were not found to 
be a valid rapresentatlon of the students- actual abilities * Therefore^ 
to avoid wasting the time and resourcei of the students ^ instructors, 
departments J and the HARD staffs the followini condition is viewed as 
necessary for involvement of HARD in P&P examination validation s k stu^ 
dent's score obtained lit the validation cestlng must count significantly 
toward the student grade. It is suggested that the test score contrl-- 
bute at least 5% (and praferably 10%) to the grade. The W^W staff will, 
of course, be very interested in any alternative approaches suggested by 
departments which would ensure student motivation. 

The justification for using a P&P test score as a contribution to 
the final grade is straightforward. If a department feels that a given 
examination is sufficiently valid for awarding proficiency credit for a 
course* than the examination should^ by definition, measure skills which 
are important in the course, and therefore be useful for measuring a 
student's final ability level* 

The staff appreciates the cooperation and suggestions which 

have been received f roca departments and Individuals , We sincerely re-- 
quest any suggestions which will assist the University in maintaining 
an accurate and flexible P&P system* 
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preceding step when the speciinen sets were re- 
viewed and the conclusion was that the examinations 
reflected the instructional objectives of the courses 
concerned,) The second and third types of validation 
represent the "comparison of the test scores of stu- 
dents completing successive courses in a sequence** 
and "concurrent validity/' reipectively. 

3. In order to accomplish the second and third 
types of validation, all currently enrolled students in 
che 101-104 courses in the five foreign languages 
are to be subjects of the study. In addition, the stu- 
dents' final jrades in the course (excluding the Col- 
lege Board test contribution) will be the criterion 
measure used. 

4. The students will take the College Board Read- 
ing and Listening tests during their regularly sched- 
uled final examination period in addition to the 
course final examination. 

5. To keep their motivation level high and consis- 

Figure 3,2. Sample table of raw score and standard score data presented to the committee for consideration 



Standi4rd Score Bqi4iv<4l€nts of UllJC Mean Scorn fir Foreign LangNage Clcisses— January i^jo 
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French loi , 


y.78 


4^5 


7^37 


444 




' ' ' ' ' ' - - •- ^ i '57 




i I . U 1 






. . . , 31-36 


541 


14.72 


507 


1 04 


41^31 


5^5 


24.02 


588 


German 101 


- . ^ . ^ 5^8 


404 


3.88 


406 


102 


. , , 24.62 


497 


I 3-74 


48S 


103. ......... 


. , , 37.54 


560 


I 6.05 


504 


104 


. ^ ^ - ^ 50-35 


622 


2 1.65 




Russian 1 0 1 


5^69 


352 


7^46 






21.32 


449 




428 


lOl. 


. . . . . ^ 37-17 


519 


I 3^54 






35-ao 


5 i I 


I 7.70 








440 


8.05 




loa 


n.41 


471 


14.92 


471 


103, , . , . . 


23.60 


546 


i 9.83 






28.72 


576 


24.36 


538 



I. The Coileie Board standard Scores range from 200 to 800 and were devised in 1941 so that the SAT candidate would have an aver- 
age score of 500* with sppfoximatelj? two^thirds scoring between 400 and 600 (that is, the standard deviation is 1 00), 
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fully by the committee fliid by selected faculty mem^ 
hers of each depanfJieot who were responsible for 
the ioi-104 courses* Following the review it was de- 
cided to use these examinations. 

STEP 4: Test Reliability and Validity 

The MARD representative waa asked to present a 
plan for administering the eKaminations experimen- 
tally. The expefimentsl adminiitracion plan follows. 

I, Since reliability coefficients of above .80 were 
reported by the tesc publisher on seeniingly com- 
parable student populacioni, no furEher reliability 
checks will be considered. 

a. Three types of validation are to be conducted 
with the examinations. The first is a content valida* 
cion by the committee and selected faculty rnembers 
of each department who are responsible for the 
101-104 courses. (This validation was dofie in the 
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tent, the students will be infofmcd by their instruc- 
tor fhac the College Board tests ^ill be used as part 
of their final exaniination in deterniitiing jrades. 
(See Figure 3. i.) 

6. MARP will provide test administrators for the 
College Board tests, and the instructors and their 
teaching assistarits will be present to serve as proc- 
tors during the escamination. 

7. MARD will secure the test booklecs and audio- 
tapes needed, and will supply the answer sheets and 
pencils. 



8= Test security and diiseminacion and collection 
of all test materials will be the responsibiliEy of 

MARD, 

y. MARD will conduct all analyses of the test re- 
sponses and prepare the results in a readable and in- 
terpretable forni for presentation to the committee, 
(See Figure 3.2,) 

10, The analyses will consist of determining (a) 
what differences exist among students enrolled in 
the 101-104 courses as measured by the College 
Board tests, and (b) the degree of relationship be- 



lugure 3.3, Sample mble of rnore detailed emmination score and grade resuks 
presented to checoinmictee for consideration 



Standard Score Me^in Test Results and Course Grades 
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tween the CoJIeje Board test scores and grades re- 
ceived in the varioui courses. (See Figure 3.3.) 

1 1, Since significafitJy different test scores be- 
tween students coftiplecing the 101-104 courses and 
validity correJaciori coefficiena of 40 to .60 are 
normally expecced in order to arrive m meaningful 
decision scores, these criteria will be employed, 

1 2. MARD will provide a recoininended set of deci- 
sion scores based upaii (a) the course difference 
analysis, and (b) the course grade versus College 
Board test score connparisons. (See Figure 3,4,) 

The type of infornrjacion items 9 and 10 call for 
should begin with ver^^ basic data. In the UIUC exann- 
ple, the cornmittee was provided with average ra^ 
scores (rtieans) which were converted to College 
Board standard scores so that the conirnittee could 
determine ho^ these srudents compared to the na- 
tional normative population. Figure 3,2 is the table 
that presented this information. Figure 3.3 presents 
a more detailed breakdown of the standard score 
test results and course grades for the cornniittee's 
informadon. The standard deviation (sD) presented 
in these figures is used to indicate the degree of 
variability or dispersion of scores*- the larger the 
value the greater the variability. 

Once the basic data were presented, analysis was 
undertaken. The results of statistical tests of signifi- 
cance on the mean scores for the languages indi- 
cated that each course w^s significantly difFerent 
from the others, progressing fron^ low scores in 10 r 
to high scores in f04 (Alearnoni, 1973). The corre- 
lation daca and the distribucion of grades plotted oti 
the College Board scafidard score base presented in 
Figure 3,4 helped the committee to see that the Coh 
lege Board scores could be used to differentiate be- 
tween successful and unsuccessful students in each 
course. 

The committee felt that the score differences 
were a realistic representation of the students* per- 
formance in the loi through 104 courses. They 
also felt that even though the listening test was pro- 
viding redundant information to the reading testj it 
should still be used in the placenfient scheme. The 
distribution of grades plotted on the College Board 
standard score scale (presented in Figure 3,4) con- 
vinced the comnnittee chat a decision score could 
be deterniined that ^ould separate basically the 
successful fronr) the unsuccessful students In each 
course. 



STEP j / Deiimmmg Decision Scores 

Two tables were generated from the analyses of the 
test data (see Figure 3.5), om containing decision 
scores based upon the mean College Board score at 
each course level, and the other contain ing decision 
scores based upon the point at which D and E grades 
no longer appeared. The resultinj tables were very 
similar. 

Because of the great similarity between the two 
decision-score tables, the committee decided co use 
the first table in Figure 3.5 as the basis for the deci- 
sion scores in the placement scheme. Then, accept- 
ing the assumption used in a previous study (Alea- 
moni and Spencer, 1968) that one year of high 
school study was equivalent to one semester of col- 
lege study, the committee generated the following 
normal placement table: 

Yian of 

High Schaof Normal 
Suidy Pliicmiui 

O. lOI 

I 1D2 

3. . 103 

3. , ID4 

4. . Beyond 104 

The committee then decided that any student who 
placed beyond this normal placernent would, de- 
pending on the average of the student's combined 
reading and listening standard scores, be given ex- 
emption credic for each course skipped up co a maKi' 
muni of four courses. 

Next, the p/R schenie agreed upon by the coniniic- 
tee (see Figure 3,6) was presented first to the LAS 
facultyt who approved it, and then to the UIUC As- 
sistant and Associate Deans Connniitree to secure 
campus-wide approval since the foreign language 
policy ^ould affect other colleges as -well. The Deans 
Comrxiittee approved the proposed system, 

STEP 6: Routim Administmtion 

Following approval of the proposed p/e scheme by 
the appropriate groups, MARD was asked to establish 
the procedures needed to obtain and administer the 
examinations and to analyze and report the results 
of the testing. The procedures ward established to 
accoinplish these tasks are presented below, 
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Figure 3,4, Samplu table presuntuti in conjunction with thu corrulatlnn data indfcLitinM fliat it possiblu m difFurentiute 
botwgen successFul and unsuccessful studcntfi in cmicIi course usini^ the College BcKird test scckus 



DistrihiitioH ofCoNrseCirddes Plotted on Averagv College Bourcl StdNdard Scores 
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Figure* h,.\ iCoNiifi/HuJl 
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Fi^^ure 3.5. Sample tables presenting tvvt) proposed ways of determining decision scores for the Foreign Language courses 



Decision Scores DetermiNed by Mean College Board Standard Score Dijferences 



Fremh 




Germiifi 




RNSSiiiN 




Spijfihh 




A retake 


P Li cement 




P/uiemeNi 


A rettige 


P/m'emeNi 


Averti^e 


Pldiement 


5/. Score 


Lere/ 




Leiei 


St, St ore 


Lerei 


Sl Score 


Level 


200-439 


iOi 


200-409 


I or 


200-389 


IOI 


200-439 


i 0 [ 


440-489 


i02 


4 10-499 


[02 


390-449 


I Oi 


440-479 


[02 


490-129 


103 


500-539 


103 


450-499 


103 


4H0-529 


103 


130^199 


104 


540-589 


1 04 


500-559 


I 04 


530-559 


104 


60Q-HOO 


Beyond 104 


Suo-Hoo 


Beyond 104 


560-800 


Beyond 10.4 


560-800 


Beyond i o.\ 



Decision Scores Determined by Passing Co/irse Grades 



French 




Cierman 








Spanish 




Average 
Si* Score 


P Lice Ml en t 
Level 


A vertige 
Si^ Score 


Phnement 
Level 


A verij^e 
St, Score 


PLi cement 
Level 


A re rage 
Si. Score 


Plucetnepit 
Level 


200-439 


I 0 1 


200-439 


\Q\ 


200-389 


IQl 


200-479 


i 0 [ 


440-5 19 


1 02 


440-509 


1 02 


390-409 


I 02 


480-489 


i 02 


520-539 


[03 


5 r 0-549 


103 


4 10-459 


103 


490-559 


103 


540-549 


[O4 


550-559 


104 


460-519 


104 


560-599 


104 


550-Hoo 


Beyond 104 


560-800 


Beycsnd 104 


520-800 


Beyond 104 


600-800 


Beyond 1 04 



Noce: College Board scorvs are now rcpDried with the third digit rounded, 



A testing and measurement specialist was given 
the responsibility to do the following: 

I, Order the test booklets and answer sheets-^ in 
this case the test books were ordered from Educa- 
tional Testing Service (ETS) and the answer sheets 
from OpScan Corporation. 
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2. Schedule the time and place of the testing — in 
this case the tests were to be given during the pre- 
college testing session scheduled from February 
through May (see Figure 3.7). 

3. Determine who would be responsible for ad- 
ministering and collecting the test material — in this 




FiMurc Example of the iilatL-mcnt sirul exemptitjii credit sciicmt.' agrixHl upijii by the committue 



PliicemHt umt Emnptm Cmllt Scheme for the Pour Pmii>n Ufwat^ts 
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0 
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Figury 3,7. BKample of schedule of testing encering 
freshmen at the uluc: 

Tmtative Schdiile 

Freshman Ch/uJame ExamiNatio^/s igji-igy^ 

February 10 . _ _ Urbana 

n ^ Urbana 

24 , Urhana 

March s. ...... _ .Chicago 

ro ........ , Urbana 

\1 ...... . Belleville, Rockfbrd, Peuria 

31 , . . Urbana, Springfield, Rnckford, Peoria 

April 7. _ . , Urbana 

14 ' • ' ^ ^ ^ ^ ^ ^ . Belleville, Springfield 

Muy ............... . Urbana 

I- ■ . . .Chicago 

\^) ............... . Urbana 

26 . .Chicago 

case it was the personnel of the PsychologicaJ and 
Counseling Testing Office, as they were responsible 
fcor the precollege testing program. 

4. Organize the test processings in this case the 
answer sheets were delivered to the mard optical 
scanning staff who produced IBM cards with all test 
responses punched in. 

5. Develop a test scoring and results presentation 
prograni — in this case a coniputer programmer fro ni 
the UIUC S Administracive Data Processing office 
worked with the testing and measurenneni spe- 
cialist to produce the program which resuku^d in the 
fornn presented in Figure 2,2. 

6. See that exemption credit for each student was 
recorded in the permanent tfanscript — in this case 
all results fornrts with exemption credit were for- 
warded to the Office of Adrnissions and Records to 
be recorded. 

7. See that the results forms were provided to the 
students, advisors, colleges, and departments — in 
this case duplicate copies of the fornis were mailed 
to the students and sent to the colleges as soon as 
they were produced. In addition, results lists con^ 
taining several students' data were provided accord- 
ing to the distribution list in Appendix B* 

O 1, Provide the colleges, departments, and advisors 
EjRJC h results inrerpretation information - see Appen- 



dix C for an example of the interpretation informa-^ 
tion provided. 

STEP 1 : Evalnatum Plan 

Although there were several proposals from the 
MARD staff as to how the effectiveness of the foreign 
language p/e activity could be evaluated, a limited 
amount of information was actually provided. One 
of the basic objectives of this P/E activity was to im- 
prove the attitudes of the students toward the re- 
quired courses and the attitudes of the instrucrors 
coward the student composition of their courses. 
Judging from the responses from the commirtee 
members and selected faculty and students, it ap- 
peared that the attiEudes of both students and in- 
structors toward the program had improved quite 
postively. 

Another objective was to reduce the proportion 
of studenti who typically altered their course place- 
ment because of mis-advising and lack of interest. 
The proportion of students who altered their course 
placement was significandy lower after the p/e pro- 
gram was implemented, 

STEP 8: Periodic Revim and Modification 

The committee agreed with the recommendation 
from MARD chat complete revalidation of the 
aminations and the system should take place ac least 
every three years to take into account any changes 
in entering students' preparation, abilities, and in- 
terests. It was also decided that the decision scores 
would be reviewed each year and adjusted as needed* 
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4. Design and Validation 
of an Exemption Model: 
Advanced Standing 
on General Education 
Requirements 

Introducing flexibility into an insticutiun's educa- 
tional program is a problern chat can best be handled 
by the use of exemption and credit examinations. 
This chapter describes how one of the CPE exemp- 
tion models^ Model 11: Advanced Standing — can 
be used to resolve such a problem. 

Exempcion has been defined in CPU as excusing 
students from a degree requirement on the basis 
of dennonsErated proficiency that may have been ac- 
quired under any auspices. In exemption, a student 
may or may not receive credit; he/she may even be 
required to take a course in place of the one ex- 
empted. So the variations in treatments rest largely 
on administrative considerations. Similarly, exemp- 
tion strategies are evaluated in large measure on the 
basis of administrative and general educational con- 
sideracions such as fairn/ess, curriculum articulation, 
social equity, institutional commitments, economics, 
and so on. 

One of the exemption models (Model 11: Ad- 
vanced Standing) found in CPE will be described 
briefly and then a detailed substantive example will 
be presented in order to illustrate the use of the 
eight steps presented in Chapter 3, 

Model II: Advanced Standi fig 

The CPE advanced standing model is concerned with 
moving able sfudents substantially ahead on the 
basis of their general educational development 
rather than knowledge of specific coursework. The 
purpose is to create more flexibility in the overall 
structure of the educational program, that is, to al- 
low well-prepared students to move rapidly into 
advanced work or to complete a degree in a shorter 
pericKl, The UIUC's exemption program is an excel- 
lent example of the advanced standing model, 



The UIUC provides three examinations which en- 
tering students can use to satisfy part or all of their 
general educational requirements. Here is how the 
eight steps presented in Chapter 2 were followed in 
implementing the general education exemption pro- 
gram at the UIUC, 

STEP 1 : Piirpose of Exmiption 

The College of Liberal Arts and Sciences (LAS), as 
well as most other colleges at the UIUC, requires stu- 
dents to satisfy four general educational require- 
ments during their first two years at the UIUC in the 
areas of Humanities, Social Sciences, Biological Sci- 
ences, and Physical Sciences. The students normally 
have to take six semester hours of credit in each one 
of those areas. The decision to establish an exemp- 
tion examination program for the general educa- 
tional requirement was based on three elements: 
feelings that there were many qualified students who 
were being subjected to an unnecessary require- 
ment, increasing pressure to recognize nonclass- 
room-based learning, and a desire to allow com- 
petent students to graduate in less time than nor- 
mally required. 

The LAS Placement and Proficiency (P & P) Com- 
mittee, made up of one representative from each of 
the four general educational areas as well as Clas- 
sics and the college administration, was authorized 
to develop an exemption examination program 
which would be submitted for approval to the LAs 
Dean's Council and then the LAS college faculty. 
Since the MARD had been experimenting with the 
use of general examinations at least one year prior 
to the formation of the las p P Committee, a rep- 
resentative of MARD was asked to help establish the 
exemption examination program* 

STEP 2: Major Instructional Objectives 

The committee specified the aggregate courses in 
the areas of Humanities, Social Sciences, Biological 
Sciences, and Physical Sciences as the objects of the 
exemption program. They further specified that the 
general competencies resulting from the various 
courses in the four areas would be appropriate cri- 
terion measures and could be assessed by examina- 
tion. After considerable discussion, the committee 
agreed to use the aggregate grades sfudents received 
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in the courses in each of these areas as the criteritin 
measure in the experimental administration. 

STEP 3:7ht to Bt Used 

The comfnittee agreed to use objectively scored ex- 
aminations in each of the four areas. It was further 
decided to secure these examinations from a test 
publisher rather than develop them on campus. 

The Checklist for Identifying and Selecting Pub- 
lished Instrurnents was employed in the following 
manner: Because of the wide publicity given the 
College Board's College Level Examination Pro- 
gram (CLEF)* and the fact that the CLEP General Ex- 
aminations were being used rather extensively by 
other colleges in Illinois, the LAS P & F Committee 
asked the MARD representative to securef sample 
copies of the CLEP tests in Humanities, Social Sci- 
ence and History, and Natural Sciences for a careful 
inspection. Once these preview copies were secured 
they were distributed to the committee members 
for review. The committee then distributed them to 
selected faculty members who were responsible for 
the courses in each of the four areas, for review, 
After this review the committee decided to use the 
three examinations with •the proviso that the two 
subtests of the Natural Sciences examination be used 
for the Biological Sciences and Physical Sciences 
areas. 

STEP 4:Test ReliahUity and Validity 

The MARD representative was asked to present a 
plan for experimentally administering the examina- 
lions. The expeririiental administration plan was as 
fbllows; 

1. Since reliability coefficients of above ,80 were 
reported by the test publishers on seemingly com- 
parable student populations, no furthtr reliability 
checks are to be considered. 

2, Twc3 types of validation will be conducted with 
the examinations. The first is a content validation by 
the committee and selected faculty members who 
are responsible fcir the courses in each of the four 
areas* (This validation was done in the preceding 
step when the sample copies were reviewed and the 

I. For furfhtir infafmarion seu CLKp PuLt Shist titiii CLKP Oen- 
mii iimi Suhjivt ExiimiNutitins, College Board Piiblicadon Orders, 
BoK 281 5j Princeton, New Jersey 08541, 



conclusion was that the eKaminatiuns represented 
the general competencies required of the aggregate 
courses in each of the four areas,) 

The second type of validation, best described as 
"concurrent validity," will be conducced at a later 
dace, 

3. In order co accomplish the second type of vali- 
dation, a representative sample of first-year juniors 
who have completed their general educational re- 
quirements will be selected in each of the four areas 
and will be the subjects of the study, 

4, The students' average grade in the aggregate 
courses in each area will be the criterion measure 
used. (See Figure 4, i J 



Figure 4.1. Sample tablf of the types of courses used ro 
generate the average grade in each of the four general 
education areas 













titiii Hnrnry 
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English 


P.sychology 


Biology 


Mathematic: 


History 


History 


Botany 


Chemistry 


Humanities 


Sociology 


Zoology 


Geology 


Language 


Political 


Physiology 


LAS 




Science 






Music 


Anthropology 


Microbiult)gy 


Astrononiy 


Art 


Ec{)nomics 


Entc^mology 




Philosophy 


LAS 







5. Each student will be sent a letter from the Dean 
of LAS explaining the study and requesting his/her 
participation on several scheduled days, 

6. In order to sdmulate cooperation and keep 
their motivation level high and consistent, the stu- 
dents will be informed ?^hat they will receive $4,00 
for the one-and-one-halt-hour examination. 

7. MARD will provide che test administrators and 
pructois for the examination. 

8. MARD will secure the test booklets and supply 
the answer sheets and pencils. 

9. Test security, dissemination, and collection of 
all test materials will be the responsibility of MARD, 

10. MARD will conduct all analysis of the test re- 
sponses and prepare the results in a readable and 
interpretable form for presentation to the commir- 
tee. 

IE. The analysis will consist of determining the 
degree of relationship between the CLKP test scores 
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and the averaje grades in each of the four areas, 

r 2, MARD will provide a recommended set of 
decision scores based upon che average grade versus 
CLKP rest score comparison. 

r 3, Campus normative data will be gathered by 
administering the three CLEP examinations to all en= 
tering freshmen during the College Diagnostic Test- 
ing Session in September. 

STEP 5: Determining Decision Scores 

The correlations between the average area grade 
and the CLEP test score, as called for in item 1 1 of 
the MARD plan, were found to be statistically sig- 
nificant in most instances and ranged in magnitude 
from ,23 to .38 (Aleamoni and Kohen, 1977)* Al- 
though the magnitudes of the correlations were not 
very high, the committee felt that they were high 
enough to use in determining decision scores. 

After considering the correlations and the dis- 
tributions of test scores in relation to the course 
grades, MARD recommended one decision score 



Figure 4.2. Sample cable showing how Ehe College Board 

test score and grade data were distributed for the junior 

sample on the C3LEP Social Sciences-History Examination 
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Figure 4. J iaifitiuNid} 
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which corresponded to the point at which the aver- 
age area grade of the junior sample was a C + for 
each of the four areas. However, the committee de- 
cided that there should be two decision scores for 
each of the four areas — one ac which the average 
area grade of the junior sample was an A, allowing 
the student to satisfy the entire general educational 
requirement in that area by receiving six hours of 
credit, and a second decision score to correspond to 
the point at which the average area grade of the 
junior sample was in the range of a C to a B + (an 
example of the type of data used is presented in Fig- 
ure 4.2), allowing the student to have the entire gen- 
eral educational requirement waived, but to receive 
only three hours of credit; the other three hcsurs 
would then be considered as elective credit. 

The recommended set of decision scores based 
upon the considerations above and the scores of 
previously tested entering freshmen ib presented in 
Figure 4^3^ 

After agreeing upon the decision scores presented 
in Figure 4,3, the committee submitted them to the 
LAS council, which approved them and submitted a 
proposal (see Appendix D) to the LAS faculty for 
final approval. The LAS faculty unanimously ap- 
proved the proposed decision scores and the CLEP 
program. 

Since the general educational requirements af- 
fected other colleges at the UIUC, the LAS-approved 



program was presented to the cannpus Assistant and 
Associate Deans Committee for consideration. 
After considerable deliberation^ the A & A Deans 
Committee decided to adopt the LAS-approved pro- 
gram as a campus^wide program, 

Because the earlier freshmen normative data did 
not adequately represent the las students, another 
testing was conducted on all entering freshmen dur- 
ing the College Diagnostic Testing Session, as called 
for in Item 13 of the experimental administrative 
plan. The results of that testing indicated that the 
original normative data did indeed yield slightly 
lower scores. After a thorough analysis of all the 
test results, the committee decided that minor 
modifications needed to be made in the decision 
scores. The modified decision scores are presented 
in Figure 4,4. 

STEP 6: Roiitine Administration 

After the clep program had been approved as a 
campus-wide program, mard was asked to establish 
the procedures needed to obtain and administer the 
examinations and to analyze and report the results 
of the testing. The procedures MARD established to 
accomplish these tasks are presented below. 

A testing and measurement specialist was given 
the responsibility to do the following: 

I. Order the test booklets and answer sheets — in 



Figure 4,3, Sample table presenting the decision scores for eKempcion and credit 
in the fuur general educacional ureas 



Pfirm N(;Ti 

Bxum Rail Si ore 

Social Sciences 
and History: 

6 Hours Credit , . . . , , . 51 

3 Hours Credit , , 41 

Humanities: 

6 Hours Credit , , 49 

3 Hours Credit §y 

Biological Science: 

6 Hours Credit ^5 

3 Hours Credit ,,.28 

Physical Science: 

6 Hours Credit 3 ^ 

3 Hours Credit 28 



Form NCTl 
Rail' Score 



53 
44 

44 
35 

3H 
31 

3^ 

27 



Board 
StafiJani 



605 

537 

fi3 
56 

62 
57 



Coilm Board 

Natkniil 

Pirciutih 



H4 

70 

82 
66 

90 
^3 

86 

7 3 



UIUC 

Preshnmi 

Pirmitili 



87 

68 
66 

56 

77 
61 



ERIC 
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Figuru 4.4, Sample table presenting che revised decision scores 

FormNC:Ti 

Exam Ran Si' fire 

Social Sciences 
and History; 

6 Hours Credit ^4 

3 Hours Credit 42 

Hurnanifies: 

6 Hours Credit , 51 

3 Hours Credit .,41 

Biological Science: 

6 Hours Credit 38 

h Hours Credit 32 

Physical Science: 

6 Hours Credit , , . , , « 39 

3 Hours Credit . . , . , - - \i 



Form Ni:T2 
Kiiti'Sfnre 



56 
44 

45 
37 

41 

35 

3H 
30 



Board 

StUPiiiard 

Sam 



620 
555 



602 
54H 

66 
60 

68 
60 



Approximate 
Co/ie^ff Bofini 
National 
PerceNii/e 



B7 
72 



B4 

82 



UIUC 

Freshmen 

PemNiiti 



70 
90 

yi 

72 

71 



this case, the test books were ordered from ETS on a 
yearly basis with a difFerenc forni of the test ordered 
each year. The answer sheets were ordered frofn 
OpScan Corporaticin, 

2. Schedule the time and place of the testing— in 
this case the tests were originally given around mid- 
semescer in the fall and spring and during New Stu- 
dent Week in August. Later they were given during 
the precoUege testing sessions scheduled from Feb- 
ruary through May, Individual testing at other times 
was possible in the Psychological and Counseling 
Testing Office. 

3. Determine who will be responsible for ad- 
min istering and collecting the test material — in this 
case it was the personnel of MARD under the origi- 
nal testing conditions. When the examinations were 
administered during the precollege testing sessions 
the personnel of the Psychological and Counseling 
Testing Office were responsible. 

4. Organize the test processing — in this case che 
answer sheets were delivered to the MARD ciptical 
scanning staff who produced IBM cards with all test 
responses punched in, 

5. Develop a test scoring and results presentation 
program — in this case originally a MARD program- 
mer produced a simple program chat resulted in the 
form presented in Figure 4,5, Later the UiUC's p & p 
program was modified to accommodate the CLnp re- 
sults as exemplified in Figure C.t of Appendix C. 

6. See chat the exemption credit for each student 



was recorded in the permanent transcript — in this 
case all results forms with exemption credit were 
first sent to the student's collage for verification and 
then to the Office of Admissions and Records to be 
recorded. Figure 4^6 presents the procedures used 
at the UIUC, 

7. See that the results forms were provided to the 
studentSj advisors* colleges, and departments — in 
this case duplicate copies of the forms were mailed 
to the students and sent to the colleges as soon as 
they were produced. In addition* results lists con- 
taining several students' data were provided accord- 
ing CO the distribution list found in Appendix B. 

8. Provide the colleges* departments, and advisors 

Figure 4.5. Sample of the initial form used to presenc 
the CLEP test results 
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Figure 4.6. Examplu (if procedurtfs (or discpibutinM ^nd rucordinM uKumption cmiic ac UlUt: 



Procedures For The Distribution And Posting Of College Level Examination 

Program (CLEP) Test Results 

A meeting was held at 3i00 p.m. on March 7 in 108 Administration Building 
to establish a procedure for the handling of College Lsvel Examination 
Program (CLEP) test results on the Urbana-Champaign campus* In attendance 
were Larry Aleamoni, Head of the Measurement and Research Division of the 
Office of Instructional Resources (OIR) , Associate Deans of Liberal Arts and 
Sciences Applabee and Bloomer ^ Director Loeb and Associate Directors Payne 
and Engelgau, Office of Admissions and Records COAR) , CLEP results are re- 
ceived by OIR, LAS students are the main participants ^ and OAR records ac^ 
cepted credit. 

CLEP is the third method introduced to campus for the receipt of credit 
through established tests* Others are the Advanced Placement Program of the 
GEEB (APP) and the campus Placement and Proficiency Program (P&P) , It was 
agreed proceduras to handle the three types should be parallel. With this 
guideline J the following general procedure is outlined * Specifies are yet 
to be developed j particularly within OIRi 

A. CLEP results are initiated or received by the Measurement and 
Resaarch Division of OIR as the campus test center* Individual 
test results from other testing centers should be directed to: 

Measurement and Research Division (OIR) 
307 Engineering Hall 
Urbana, Illinois 61801 

OIR, through tape matches j will identify the test participant 
as an applicant for admission (new student) ^ enrolled student, 
or neither. 

B. Test results of applicants for admission (new students) j due 
either to testing on this campus or the results sent from other 
test centers s will be coordinated with the current handling of 
the campus Placement and Proficiency tests* 

1* Results will be listed on individual reports 

2, Both ?BiV and CLEP results will be sent through OAR and the 

established procedures of the Pre-College Program to the 

Colleges in time for suiroier advance enrollment - 

a* CLEP tests taken in advance will accompany P&P results 
to the college at least two days In advance of the new 
student's summer advance enrollment appointment* 

b, CLEP results taken the day before the new student's 
advance enrollment appointment will be sent directly 
to the college from OIR just like the aural portion 
□f the foreign language results are presently* 

3g 

28 



iSUthi/s nflmplimeiitin^ Cfill^^i P/m^ntiut am/ Exemptimi Programs 



3. Colleges will be responsible to report back to OIR any 
duplications in credit between CLEP and P&P and, for trans- 
fer students, transfer coursawork credit. If credit usually 
granted is not^granted due to duplicatlOTis ^ the college 
shQuld 30 notify 6lR, Procedures for this reporting will be 
clarified by Dr. Aleamoni's office* 

4. OIR will send to OAR, after registration, a clean tape 
report (no duplicate credit) on all P&P and CLEP initiated 
credit. OAR will check this credit agaiTist credit gained 
through the Advanced Placement Program. A^y duplication 
of credit will be checked with the college and posted fol- 
lowing the collegers directions, Other credits will be 
posted following current procedures. It was felt that per-- 
haps the Advanced PlaceBaent Program test results should 
also be received by OIR, This will be pursued at a later 
date* 

5. If test results are received between the new student's ad- 
vance enrollment and registration or are initiated during 
New Student Week, they will be reported directly from OIR 
to the appropriate college and follow the guidelines above 
for posting on the student's ledger, 

C* Test results from other testing centers or from the University 
of Illinois as a national testing center received for students 
currently enrolled will be forwarded^ with credit earned noted, 
from OIR directly to the appropriate college. For posting on 
the student's ledger, the college will send a 4 k 6 Notice of 
Advanced Standing to; Records, 69 Administration Building, 
Office of Admissions and Records* following current procedure. 

D, If the student cannot be identified, the score will be kept by 
OIR for rechecking at a later date, 

OAR records will update the test credit tape generally described 
under 4 above with Advance Placement Program credit or with test 
credit which arrives after the tape. This augmented tape will then 
be. loaded to the STM, upon Joint request from OAR, OIR, and ADP, 

PREPARED Ml Gary R, Engelgau 

Associate Director for Admissions 



DATES 
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wifh results inrerpretation informacion — see Ap^ 
penclix C for an example of the interpretation infor- 
mation provided. 

STEP 7: Evalmtwn Plan 

The MARD staff agreed to gather data on what 
courses the students acEually rook and what grades 
thefy received. This information would then be used 
to determine the patterns of courses taken and 
grades received by students receiving (a) no credit, 
(b) waiver, (c) waiver and three hours credit, and 
(d) waiver and six hours credit. The results of this 
foilow-up would be used to determine if students 
actually undertook more advanced courses and/or 
coiTipleted their degrees in a shorter time period. 
Modifications of the program would depend upon 
the results of the follow-up study. 

In addidon a complete analysis of the cost of the 
program to the University and participadng stu- 
dents should take place each year to determine if 
any ptjlicy changes are needed, 

STEP 8: Periodic Review and Modification 

The comrnittee agreed to authorize a complete re- 
validation of the examinations and the system at 
least every three years to take into account any 
changes in the entering students' preparadon, abili- 
ties, and interests. It was also decided that the deci- 
sion scores would be reviewed each year and ad- 
justed as needed. 



5, Design and Validation 

of a Placement Model: 

Remediation 

in Language Skills 

By Joseph W. Dougherty, Wesky Co/kgi 

Two of the most urgent concerns of any institution 
attempting to develop an effective program of stu- 
dent assessment and placement are first, a compre- 
hensive program of special academic services to 
facilitate the individualizing of student academic 
programs, and second, a comprehensive testing pro- 
gram. This chapter presents the model which Wesley 
College developed to meet these concerns, and illus- 
trates how the eight steps discussed earlier were 
followed in implementing this program. The chap- 
ter describes Wesley's Learning Resources Prograni 
and explains the development and implementanon 
of its student assessment battery, the Wesley Col- 
lege Student Learning Profile. 

STEP 1 ■ Purpose of the Learning 
Resources Program 

In 1972, Wesley College, along with small liberal 
arts colleges across the country, was confronted with 
the problem of increasing numbers of vocationally 
oriented students who lacked the basic academic 
skills to achieve their educauonal goals. This prob- 
lem was further compounded by the enrollment of 
larger numbers of older, nontraditional students. 
Consequendy, the college experienced a far wider 
range of academic and personal strengths and weak- 
nesses in its incoming freshmen than at any time in 
its history. In order to serve the widely diverse ed- 
ucational needs of these students, the Learning Re- 
sources Program (lrp) was developed. The LRP is a 
compleK of six educational services designed to 
meet the individual academic and personal needs of 
each incoming student The six services are listed 
below, 

1 , The Academic Skills Program 

2. Learning Center Counseling Services 



38 



3, ASK — The Academic Skills Counseling and Tu- 
torial Service 

4, COPE— The Center for Occupational and Per* 
sonal Experiences 

5, The College Advanced Placemen c Program 

6, The Adniinistration and Interpretation of the 
Wesley College Student Learning Profile 

Learriing Profile 

The sixth and last responsibility of the LRP is, in 
fact, the most important and the one which makes 
all the others possible, It is part of this activity that 
will be described here. Because of the increasing 
academic diversity of incoming students, the college 
\vas attempting a greater individualization of each 
student's academic program through the LRP, but 
this individualization was impossible without lome 
form of student assessment which would provide 
early identification of the academic and personal 
strengths and weaknesses of incoming students. 
Therefore, the college sought to develop a testing 
program which would accomplish the following ob- 
jectives: 

1, Provide a comprehensive assessment of the 
verbal, mathematical, scientific, and study skills of 
all incoming Wesley College students. Only the use 
of the verbal skills assessment is described here, 

2, Serve as a reliable predictor for successful ad- 
vanced placement for students exhibiting academic 
strengths. 

3, Providr specific diagnostic information on the 
academic weaknesses of students. 

4, Provide specific information regarding the 
basic skills of each student which could be shared 
with the student's faculty so that each instructor 
could effectively individualize each course, 

STEP 2: Major Institiitional Object km 

This proposed battery of tests would be adminis- 
tered to all incoming Wesley students to determine 
their readiness to pursue entry level courses in Eng- 
lish. 

For example, every first semester freshman was 
required to take the English Composition course, 
and the next course in sequence was the Introduc- 
tion to Literature course. The English Department 
had established both specific prerequisites for Eng- 
lish Composition as well as a series of competencies 
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expected of those completing the course. In re- 
viewing the available standardized test and essay 
formats, every attempt was made to match the In- 
structional Objectives of each course sequence with 
the contents of each assessment instrument. After 
experimentation with several alternative instru- 
ments we selected those which best correlated with 
the final grades in each course sequence. We then 
formed the test battery for the Verbal Profile, the 
Mathematics Profile and the Science Profile, Each 
profile could then be used for the follov>'ing three 
purposes: 

1. To identify those students whose skill deficien- 
cies would require remedial or developmental 
courses, 

2. To place students more accurately \vithin the 
course sequence. 

3. To identify those students who qualified for 
exemption and/or advanced placement. 

STEP 3: Tests to Be Used 

We had two criteria for tests in each area: 

(1) They should be instruments which were not 
solely placement instruments but which could pro- 
vide specific diagnostic information as well, and 

(2) all such information should be in a form that 
could be readily shared with each student's instruc- 
tors and faculty advisor. 

With these criteria and our original objectives in 
mind, the college solicited the help of J. Evans Alio- 
way, Director of Test Development at the Educa- 
tional Testing Service in Princeton, New Jersey. 
With Dr. Alloway's invaluable assistance and after 
three years of research and development, the college 
formulated the Wesley College Student Learning 
Profile, a placement and diagnostic instrument which 
would enable the college to: 

I. Collect data about the students affective and 
cognitive skills, 

a. Develop a realistic assessment of the student's 
academic and personal strengths and weaknesses 
through interpretation and diagnosis of these data, 

3, Establish and implement an efifective program 
of placement and exemption to meet the individual 
student's needs. 

To facilitate the collection of test data, the college 
required all incoming students (usually between 400 
and 450) to participate in one of two, two-day New 
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Student Orientation Progmnis held in late May and 
mid-June^. In addicion to testing incoming students 
this program provided an opportunity to orient stu- 
dents effectively to all the various programs and 
services offered by the college. At the completion 
of these progratris, all tests were scored, results re- 
corded, transcript information collected, and the 
Studerit Learning Profile for each student compiled 
by late July. 

The Wesley College Student Learning Profile con- 
sists of the following components: 

1. Verbal SkiUs Profih, Reading, Writing, Spelling, 
Punctuation, Grammar, Vocabulary, Diction^ Usage, 
etc. 

2. lAath ^civfice Profile. Arithmetic Computation, 



Elementary Algebra, Basic Mathematics Concepts, 
Intermediate Algebra, and Basic Science Skills. 

3. Study Skilh Profih. Problem Solving, Under- 
lining, Library Information, Study Skills Techniques, 
General Study Habits and Attitudes. 

4, Personality Profiie, Subscores from the Strong 
Campbell Vocational Interest Inventory, California 
Psychological Inventory, and, in some cases, the 
Minnesota Multiphasic Personality Inventory. 

The present form of the Wesley College Student 
Learning file is reproduced in Figure 5,1, 

The entire profile is used as a single diagnostic 
instrument, but the following pages describe and 
explain only the Verbal Skills Profile as a model of 
verbal skills assessment. 



Figure 5,1. The Wesley College Student Learning Profiie 
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The Verbal Skills Profile 

An institution which is commicted not merely to a 
program of efFective placement and exemption but 
also to a viable remedial/developmental program 
must know the type and extent of a student's verbal 
deficiencies. In order co assess each incoming stu- 
dent's range of verbal skills* we developed a bat- 
tery of verbal tests which, together with information 
from the student transcript, enabled the college to 
assign the student to the appropriate courses and 
arrange for the appropriate remedial work. The 
Verbal Skills Profile utilizes seven different mea- 
sures (see Figure 5, i ), described below. 

Measure i: College Board Scholastic Aptitude Test, 
Verbal Score, The verbal section of the College Board 
Scholastic Aptitude Test is a multiple-choice test 
which measures reading comprehension* verbal rea- 
soning and vocabulary. The student's score is re» 
ported on a standard score scale of 200 to 800, In 
1976* the National Mean for the SAT Verbal Score 
was 434. The average SAT Verbal score for entering 
Wesley College freshmen in 1976 was 418. 

Meas/tre 2: The Sequential Test 0/ Educational Prog- 
ress Test of English Expression, Form lA. The English 
Expression Test measures the ability to evaluate the 
correctness and effectiveness of sentences. The test 
is composed of two parts. In the first. part, the stu- 
dent is asked to solve such problems as agreement 
between subject and verb or pronoun and refer- 
rent, and the selection of an adjective or adverb. 
The second part of the test consists of problems in 
sentence structure* word order, idiomatic expres- 
sion, and diction. In 1976, the National Mean for 
the STEP Test of English Expression, Form lA was 
the 47 percentile (34 of the 65 test items answered 
correctly). The Wesley College mean was the 37 
percentile (30 of the 65 test items answered cor- 
rectly). 

Measure j: The Sequential Test of Educational Prog- 
ress Test of Readings Form lA. The Reading Test mea- 
sures the students ability to read and understand a 
variety of materials. The reading passages utiliEed in 
the test include stories and poems as well as selec- 
tions from the literature of the sciences, social 
studies, and humanities. The three specific reading 
skills measured by the test are comprehension^ trans- 
lation and inference, and analysis. STEP defines 
comprehension as the ability to understand written 
material which implies a knowledge of sentence 
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structure and word relationships and involves a 
recollection of sequences of ideas and facts. The 
skill of translation and inference is defined as the 
ability to identify ideas when they are stated in lan- 
guage different from' the original presentation; to 
deduce the meaning of figurative or obscure words, 
phrases, or sentences; to apply ideas to new situa- 
tions; and to recognize specific inferences. Finally, 
analysis measures the student s ability to recognize 
and appraise, first, literary devices, tone* and logical 
structure^ and second, the author s purpose and the 
attitudes and beliefs which influenced what he 
wrote. The National Mean for the STEP i A Reading 
Test was the 43 percentile (33 of the 60 items an- 
swered correctly). The Wesley College average was 
the 29 percentile (28 of the 60 test items answered 
correctly). 

Measure 4: The College Boffrd Test of Standard \Y&ii' 
ten English. Through an arrangement with the Col- 
lege Board and Educational Testing Service, Wesley 
College administered the Test of Standard Written 
English (TSWB) to every incoming student regard- 
less of whether he or she had previously taken the 
test at an SAT administration. Furthermore, it was 
on/y the score from the Wesley College test adminis- 
tration which was recorded on the Verbal Skills Pro- 
file. The TSWB is a thirty-minute test containing 50 
multiple^hoice items about the kinds of conven- 
tional and formal English that students are usually 
expected to use in college papers. Scores are re- 
ported on a range of 20 to 60. The TSWE was not de- 
signed for use in admissions decisions, but is in- 
tended to assist with the placement of students in 
the appropriate instructional sequences. It is a rather 
easy test and discriminates best among students of 
relatively low writing ability. The mean score for in- 
coming Wesley College students on the TSWB was 
40 in 1976. 

Measure The Sequential Test of Educational Prog- 
ress Mechanics of Writing Test, Form 2 A, The STEP 
Mechanics of Writing Test measures the student's 
skills in spelling, capitalization, and punctuation by 
asking the student to identify misspelled words and 
to detect errors in capitalization and punctuation in 
the context of given sentences. The National Mean 
for this test was the 43 percentile while the Wesley 
College average was the 37 percentile. 

Measure 6: The Wesley College Writing Sample. In 
developing the battery of tests for the Verbal 
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Skills Profile, the college felt it essential to include 
an actual writing exercise. Once again, the college 
requested the assistance of Evans Alio way , of ETS, 
in the formulation of a writing sample. After 
much discussion, a writing sample was developed 
which consisted of two distinctly different writing 
tasks. The first of these was a business letter in which 
the student expressed his concerns about a highly 
defined issue. The objective of this writing task was 
-^to assess the student*s written expression in a rele- 
vant, welKdefined context. The objective of the sec- 
ond task, which presented the student with a much 
more hypothetical issue, was to determine the stu- 
dent's competency in responding to an intellectual 
issue in a more traditional and formal essay. The 
Wesley College Writing Sample Test is presented in 
Figure 5.2. These essays were then read by two 
members of the VC^sley College English Depa^^ 
ment and hDlistically scored. The systems of holis- 
tic scoring employed called for each reader to score 
each part of the Writing Sample on a scale of i to 6, 
Thus, the possible range of scores on the Wesley 
College Writing Sample was 4 to 24. The average 
Wesley College student score was 14, 

Meas/ire 7; High School English Grades. The final 
component in the Verbal Skills Profile was a record 
of the student^s ninth, tenth, eleventh, and twelfth 
grade English grades. In addition to recording the 
arithmetical or letter grade, a notation regarding 
course content was also made in those cases where 
that information was available. This notation was 
usually in the form of an exponent abbreviation 
(85W, for example, meant an 85 in a writing course), 

STEP 4: Test Reliability and WHdity 

As we secured the individual instruments over the 
three-year period, each test was given to groups of 
freshman English students, scored, and the results 
compared to the actual performance of those stu- 
dents in the English course. This initial experimen- 
tal administration served to document both the re- 
liability and validity of our instruments. However, 
as a further check of both reliability and validity, 
and before instituting the mandatory entry testing 
policy, the college conducted an experimental ad^ 
ministration of all the tests on the new Student 
Learning Profile over two three-day periods in June 
1974, when the 380 incoming students were admin-^ 



istered the complete battery of tests. The tests were 
either scored by members of the college faculty or 
were sent away for machine scoring. Two members 
of the college's English Department holistically 
scored the Writing Sample. While the scoring was in 
process, three members of the college s administra- 
tive staff worked on collecting all transcript infor- 
mation and recording it on the profile. After this 
was accomplished, all test scores were recorded on 
the profile (in the format illustrated in Figure 5.1). 
This done, the completed profiles were given to the 
Director of the Learning Resources Program (who 
had been responsible for the development and im- 
plementation of the test battery) for interpretation 
and diagnosis. ^ 

STEP 5: Determining Decision Scores 

In determining the decision scores to be utilized in 
the placement of students, the director had at his 
disposal the data collected from the previous experi- 
mental administrations in each department. Basing 
his decision scores on the correlanons established in 
those earlier administrations, he proceeded to ana- 
lyze each student's learning profile. 

hiterpritation and Diagnosis 
of thi Verbal Ski/Is Profile 

In explaining our procedures for interpreting the 
Verbal Skills Profile, it should be stressed that each 
measure complemented the others and no single 
measure was used independently of any others. 
However, general norms were established for each 
measure and, as a rule, these individual test norms 
correlated very predictably with each other. The 
specific norms utilized in our interpretation and 
diagnosis of the Verbal Skills Profile follow. 

Meastiri 1: The College Board Scholastic Aptitude 
Test, Verbal Score. In order to develop initial norms 
for placement of students into the Developmental 
Writing Program, Wesley College analyzed the rela- 
tionship between the Verbal sat score of incoming 
freshmen and their final English grades. This analy- 
sis was conducted in the spring of 1976, utilizing 
the scores of incoming freshmen in 1974 and 1975. 

Our analysis showed that 89 percent of all incom- 
ing freshmen with a Verbal SAT score above 350 
received a final English Composition grade of C or 
above. Likewise, it was found that 83 percent of all 
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Figure 5,2, The Wesley College Writing Sample 

jPlrections i This test consists of two writing exer^seseach of which 
raquires a different composition process. Pay particular attention to 
the situation presented and the kind of writing required for it. 
You must stay within the time limit for each exercise so that you do 
not work too long on one part at the expense of the other. Times will 
be announced periodically throughout the examination. 

Label each writing exercise Part A or Part B^. Be careful to write your 
essays on every other line of the examination books i 
WriCe your name on the front of each book. 

Part A " Time: 30 minutes 

As part of your preparations for going away to college ^ you have recently 
purchased an expensive ^ quadrasonlc stereo system (the system includes 
a turntable^ a cassette tape^player, severalampllf ierSj toui portable 
speakers, and a set of head phones). Although you had some misgivings 
about Its eKpsnse^ you had no doubLS whaLSOever about Its quality. 
Howeverj after it is delivered to you, you find that your stereo system 
has major defects, You attempt on numerous occasions to have the 
problems corrected. Despite your repeated efforts , you have been 
unable to get the store which sold it to you either to repair the 
system or replace it. Write brief letters (three or four paragraphs 
each) concerning your defective stereo systems 

1 Write the first letter to the salesman who sold you your stereo. 
State your complaint (s) and suggest what action should be taken, 

2 Write the second letter to your local Chamber of Commerce or Better 
Business Bureau, reporting your failure to get full satisfaction from 
the store or dealer which sold you the stereo system. 

In each letter be sure that your style and tone are suitable to your 
audience, that your complaints are specific, and that your expressed 
indignation is appropriate to the circumstances you describe. 

Part B - Time: 30 minutes 

Some officials have recently proposed a system of national service 
for a period of two or three years for every young man and woman, 
beginning at age eighteen. Some young people could serve in the armed 
forces, others could do conservation work in the national parks and 
forests, others could serve in the Peace Corps, still others could be 
employed in various kinds of social or educational work. 

Discuss whether or not you think such a plan would be desirable and 
give reasons for your view. 
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Figure 5,3. Final English grades of incorning freshnien 
with a Verbal SAT score of 3 50 or belQW 
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Figure 5,5. Final English grades of incoming freshmen 
with STEP I A English Expression Scores 
in the a5th percentile or below 
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Students scoring 350 or below received a final Eng- 
lish grade of D or F. The specific grade discribiition 
of these two groups is presented in Figures 5.3 and 
54. Accordingly unless there were other prevailing 
data or» as in the case of the older* nontraditional 

Figure 5,4, Final English grades of incoming freshmen 
with a Verbal SAT score above 350 
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Student, indicators of significant development in 
verbal skills since the sat was taken, all students 
with a score of 350 or below were recommended to 
an appropriate section of the Developmental Writ- 
ing Program. The Verbal SAT score was employed 
only as a secondary, not a primary, predictor of suc- 
cessful advanced placement 

MeasNn 2: The Sequintial Test ofEdidCatiotial Prog- 
ress Tisi of English Expnssion, Form lA. In attempt- 
ing to determine appropriate norms for the step 
English Expression Test, we once again had the ad- 
vantage of data collected with sample populations 
of freshmen during the previous two academic years. 
Once again, we analysed the relationship between 
entry scores on the English Expression Test and 
final English Composition grades. The results of 
this analysis indicated that 88 percent of all incom- 
ing freshmen who scored above the agth percentile 
(raw score of 27 correct answers in the 65-item test) 
received a final grade of C or above, and 79 percent 
of those who scored at the ajch percentile or below 
received a final grade of D or F, Consequendy, it 
was decided to use the 25th percentile as the appro- 
priate decision score for placement into Develop- 
mental Writing, The results of our analysis of the 
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EngUsh Expression Test and final English grades are 
presented in Figures 5.5 and 5,6. 

This test was excremely valuable in assessing the 
specific verbal weaknesses of chose students who 
were placed in the Developmental Writing Program. 
Moreover, because these data (not only the overall 
test results but the specific item analysis for each 
student) were available two months prior to the start 
of the fall semester, we were able to more eflFec- 
lively assign students to particular sections of De- 
velopmental Writing as well as to provide the in- 
structors the opportunity to select materials and 
develop course syllabi specifically directed at certain 
verbal deficiencies (i.e., sentence structure^ vocabu- 
lary development, diction and word choice, etc.). 

However, as with SAT, the STEP test of English 
Expression was not a primary indicator of successful 
advanced placement. 

Meas/4r^ j: The SeiiuenUal Test of Educatiotml Prog- 
ress Tesi Of Km ding Form //I. We had no previous ex- 
perience in developing norms for interpreting the 
Reading Test, as we did with the SAT Verbal and the 
English Expression Test. Moreover* because of the 
high number of very low reading scores and the 
limited scaflF in the Developmental Reading Pro- 
gram, we had to use a lower cutoflf norm than de- 
sired. On the basis of the little data we had relating 
STEP Reading scores to freshmen students' first- 
Figure 5.6. Final English grades of incoming freshmen 
with STEP I A English Expression scores above the ajch 
percentile 
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Figure 5.7, Distribution of first semester 
grade point averages of incoming freshmen 
with scores at the 23rd percentile 
or below on the STEP i A Reading Test 

4^ 
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semester Grade Point Averages (see Figure 5.7)^ we 
decided that the most practical figure would be the 
23rd percentile (26 correct answers of the 60 test 
items). Accordingly* every student scoring lower 
than 461 (converted score) was assigned to the De- 
velopmental Reading Program. While there is no 
doubt that all these students required the Reading 
Program, there are indicators that students who 
might have benefited from the program were ex- 
cluded. Preliminary analysis of this group suggests 
that the present percentile cutoff be raised to the 
34th percentile. 

In general, the Reading Test was not used to pre- 
dict successful advanced placement of students. 

Measun ^: The Collige Board Test of Standard Writ- 
ten English. In establishing placement norms for the 
TSWE, we had the benefit of two years* experience 
utilizing these scores. A score of 32 was established 
as an indicator for assignment to the Developmental 
Writing Program, The basis for this cutoff score was 
our analysis of the relationship of students' TSWE 
scores to incoming freshmen students' grades. The 
results of this study showed that 91 percent of all 
students who scored 32 or below on the TSWE re- 
ceived a D or an F in English Composition (see 
Figure 5.8). However, experience proved that de- 
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Figure 5.8. Final English grades of Incoming freshmen 
with TSWE scores of 32 of below 
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pending on such other important variables as read- 
ing ability, general study skills, and mechanics of 
writing compecency, students with scores ranging as 
high as 39 had difficulty in completing the English 
Composition course. Figure 5.9 depicts the grade 
distribution of those students scoring between 33 
and 39 on the tswe. An analysis of those students 
scoring 40 or above on the tswe documented that 
95 percent of all students in this group received a 
final grade of C or better in English Coniposition 
(Figure 510)^ The TSWE, then, was a most effective 
indicator of verbal deficiencies when used as part of 
the total Verbal Profile. 

The TSWE has also become our primary predictive 
measure for successful Advanced Placement in Eng- 
lish Composition. The English Department at Wesley 
College offers advanced placement in English Com- 
position to any student who scores 500 or above on 
the English test of the CLEP General Examination 
and scores 18 or above on the holistically scored 
writing sample. During the three years in which the 
TSWE has been a part of the Verbal Skills Profile, we 
have used a score of 56 on the TSWE to predict suc- 



cessful CLEP performance. During this time, 52 of 
the 59 students who scored 56 or above on the 
TSWE scored 500 or above on the CLEP General 
English Examiination, 

Mmsi^re j: The Sef/ueritia/ Test ofEdNcational Prog- 
ress Mechanics of Writing Test, Form 2 A. In analyzing 
student scores in the Mechanics of Writing Test, we 

Figure 5.9* Final English grades of incoming freshmen 
with TSWE scores between 33 and 39 
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Figure 5,10, Final English grades of incoming freshmen 
with TSWE scores of 40 or above 
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Figure 5,11. Final English grades of incoming freshman 
with Wesley College Writing Sample scores of i i or below 
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were receiving information found nowhere else in 
the Verbal Skills Profile, except in the Writing Sam- 
ple. The information provided by the test was es- 
pecially significant in that it frequently accounted 
for what seemed to be discrepancies between the 
scores of two or more of the other measures, Like 
the other STEP tests, this one was particularly useful 
in diagnosing specific writing problems and in pro- 
viding instructors with insights into material selec- 
tion and course content. Any student with a con- 
verted score of 459 or 25th percentile was diag- 
nosed as requiring either Developmental Writing 
or Mechanics of Expression, An individual item 
analysis together with the individual student's scQres 
on the other measures determined which of the two 
courses would be recommended for the student. 

Because of the nature of the test, it was found to 
be of very little assistance in predicting successful 
advanced placement 

MmsNfi 6: The Wesley Co/iege Writing Sample. The 
Writing Sample developed for use with the Verbal 
Skills Profile has proved to be very useful in pro- 
filing both the strengths and weaknesses of our stu- 
dents* written expression. There has been such con- 



currence about its value within the English Depart- 
ment that the department has specified a holistic 
score of 18 as a prerequisite for taking the CLEP ex- 
amination for advanced placement. A score of 1 1 or 
below has been established as an indicator of assign- 
ment CO the Developmental Writing Program. This 
score was based on an analysis of the Writing Sam- 
ple scores of incoming freshmen in 1974 and 1975 
in relation to their final English grades. It was found 
chat of the students with Writing Sample scores of 
1 1 or below 83 percent received a final grade of D or 
F, while of the students with scores of 12 or above, 
92 percent had final English grades of C or above. 
Figures 5,11 and 5.12 depict the actual grade dis* 
tributions of these two groups of students. How- 
ever, depending on other variables within the pro- 
file, students with scores as high as 13 have been 
assigned to the program. 

Measure j: High School EngUsh Grades. Over the 
pas^c four years, high school English grades have 
become less valid as predictors for either develop- 
mental or advanced placement, In fact, it was the 
growing concern about their validity which was in 
part responsible for the development of the Verbal 
Skills Profile. However* they provide us with the 
only indication of the students actual performance 
in verbal skills courses. 

Figure 5.12. Final English grades of incoming freshmen 
with Wesley College Writing Sample scores of 1 2 or 
above 
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STEP 6: Routim Administration 

Arranging for routine adminiitration was a compara- 
tively easy step in the development of the Wesley 
College modeL Both the faculty and the academic 
dean were committed to developing as much infor- 
mation as possible on the academic strengths and 
weaknesses of each incoming student. Moreoverj 
the dean of students and the college counseling 
office as well as the president were eager to est- 
ablish a mandatory on-campus orientation program 
for all new students. It seemed that both objectives 
could be met by conducting a series of required 
two- or three-day New Student Orientation Pro- 
grams during the month of June. This would also 
provide sufficient time for the scoring of all tests, 
the completing of all students' Learning Profiles, the 
analysis and interpretation of each Profile, and the 
transniittal of in formation to all instructors and ad- 
visors. Such a proposal was made and approved and 
the policy of mandatory New Student Orientation 
prior to enrollment and registration became part of 
the Wesley College Bulletin and all applicants to the 
college were so informed. 

STEP 1 : Eval nation Plan 

To maintain the Student Learning Profile as an ef- 
fective placement and exemption instrument, the 
Learning Resources Program staff developed proce- 
dures for both internal and external evaluations. The 
internal evaluation consisted of an analysis of the 
academic performance of four student groups, de- 
fined in the following way: 

Group I — Students whose learning profiles indi- 
cated weaknesses in basic academic skills and who 
were assigned and did complete Academic Skills 
Program courses. 

Group 2 — Students whose learning profiles indi- 
cated neither a need for developmental work nor 
the potential for advanced placement. They were 
enrolled in the entry level freshman courses. 

Group 3 — Students who were identified as candi- 
dates for successful advanced placement in one or 
more courses. 

Group 4 — Students who, although identified as 
requiring the remedial or developmental courses of 
the Academic Skills Program, did not for one reason 
or another take these courses. 
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In 1976-77, 171 students of the entering class of 
427 were identified as requiring at least some reme- 
dial or developmental course work. Of this number, 
five students failed to report to the college in the 
fall and four withdrew at some point during the 
semester. This left 162 students who completed the 
Academic Skills Program (Group i). Of this num- 
ber, three students were declared academically in- 
eligible to return at the end of the first semester, and 
twelve at the end of the second serriester. This left 
147 students academically eligible to return for the 
sophomore year. These figures become especially 
significant when compared to those for Group 4. 
This group consisted of 37 students who were iden- 
tified as also requiring remedial or developmental 
instruction in one or more areas but who, for one 
reason or another, were unable or unwilling to enroll 
in the Academic Skills Program. In this group, 22 
students were acadeiiiically ineiigibie to return after 
the first semester and 9 more were academically in- 
eligible to return after the second seniester, leaving 
6 students in Group 4 eligible to retura for the soph- 
omore year. 

In analyzing the performance of the students in 
Group 2j the following things were observed: (i) A 
significant decrease in the number of failing course 
grades given to freshmen; (2) a slighF: rise in the aver- 
age freshman grade point average; and (3) a reduc- 
tion in first and second semeiter freshnian attrition. 

In Group 3 we found that 8a percent of all stu- 
dents recommended for advanced placement suc- 
cessfully achieved it. Moreover, 78 percent of all 
those who entered the next course level in the se- 
quence achieved a grade of B or higher. 

Our primary external evaluation, conducted by 
the Educational Testing Service in Princeton, New 
Jersey^ attempted to provide us with data on the 
accuracy of the Verbal Slcills Profile's prediction of 
freshman writing performance. This analysis yielded 
the following results; 

1, The Verbal Skills Profile was a very valid pre- 
dictor of the students' academic performance in 
entry level English courses. 

2, The most valid prediccors of academic per- 
formance in English courses were the tswe, step 
I A English Expression Test, and the Writing Sample, 
High school English grades and high school rank 
were the least valid prediccors. 
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STEP 8: Periodic Revimv and Modification 

To maincain the effectiveness of the Wesley College 
Student Learning Profile, we have developed a pro- 
cedure for its periodic review and modification. 

1, Every year we experimentally administer new 
tests within the academic departments and the 
Learning Resources Prograni. These new tests are 
correlated with actual student performance, and the 
correlations are compared with those derived from 
the tests presently conscicuting the profile. 

2, The ongoing evaluation of the present testing 
battery as described in Step 7 is conducted on an 
annual basis. 

3, The monitoring of entry=level freshman courses 
for changes in content or grading policy is under- 
taken. 

4, A careful review of admissions data takes place 
every year, iRformation regarding the rise or fail of 
incoming freshman SAT scores and changes in the 
proportion of freshman rank in high school gradu- 
ating classes are carefully examined. 

5, Every year a careful study is made of the aca- 
demic performance of those students granted ad- 
vanced placement, and that performance is compared 
with that of other students who had completed the 
prerequisite course. 

6, Periodic examination is also made to insure that 
there is no redundancy among the information af- 
forded by the different instruments. If this occurSi 
the battery can be shortened by eliminating one or 
more of the tests. 

7, Institutional analysis of students' academic and 
social adjustment and development is also continu- 
ally reviewed to determine whether additional mea- 
surement of student competencies or traits would be 
helpful. If so, the battery of tests is expanded to 
include appropriate new measures. Of course, in 
adding new measures to the battery, the eight steps 
illustrated here would once again be followed. 

Any changes which seemed appropriate would 
originate from the office of the director of the Learn- 
ing Resources Program, who would propose them to 
both the academic committee of the faculty senate 
and the academic dean of the college, 
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6. A Concluding Note 

Ideally, before the development of a placement and 
exemption program is undertaken^ the current in- 
stitutional practices and policies should be identi- 
fied. Typically^ however, the program is started and 
sometimes completed before any such policies and 
procedures are identified. Here are a few brief 
thoughts and suggestions on how to assess and plan 
for placement and exemption acdvities on a campus. 

First of alls consult the college catalog and book of 
rules and regulations for students to identify the cur- 
rent policies and practices. If these sources indicate 
that individual departments need to be consulted 
concerning their policies and practices, arrange for 
consultations with the appropriate faculty or ad- 
ministration members. 

If you discover that no practices and policies ex- 
ist, then you should determine whether placement 
and exemption activities are actually needed. Iden- 
tify the individuals who are interested in promoting 
such activities and discuss with them the areas such 
activities should cover. 

If some placement and exemption activities and 
policies already exist, you should determine (a) 
whether they are needed, (b) whether they are used, 
(c) whether they are department, college, or uni- 
versity based, (d) who is responsible for the prac- 
tices, and (e) who enforces the policies. To conduct 
a careful evaluation of the current practices and 
policies^ seek answers to the following questions: 

1. Are the policies appropriate for the institution? 

2. Are the practices consistent with the policies? 

a. Do current practices satisfy current needs? 

b. Should the practices be expanded? 

3. Are the practices and policies consistent across 
departments? 

4. Was empirical evidence used to establish the prac- 
tices? 

5. Are the practices defensible? 

6. Are the practices regularly evaluated or reviewed? 

7. Are students and faculty content with the prac- 
tices and policies? 

8. Who should be responsible for conducting such 
evaluations? 

After such an evaluation has been conducted, you 
should determine who is to continue the appropriate 



•^9 



placement and exemption activities and who Is^to 
initiate additional activities. In addition, it is im- 
perative to deterinine vv^here the political, rnonetary, 
staff* space, and equipment support are to come 
from. Should such support be provided by the de- 
partment, college, university, or some combination 
of all three? 

In order either to modify existing placement and 
exemption policies and procedures or to initiate 
new ones, it is imperative to identify and establish 
the appropriate departmental and college faculty 
liaison persons, because these are the individuals 
who would be involved in developing examinations, 
conducting studies, and establishing policies. It Is 
essential to determine and agree upon the tasks that 
each of these individuals would be capable of and 
willing to handle. 

Very few institutions have taken the time or the 
trouble to establish policies and procedures relat- 
ing to placement and exemption activities. Faced 
with such a situation, you can formulate institutional 
policies and procedures by finding answers to the 
frjllowing questions: 

1. Who actually awards credit — the department, 
college, etc.? 

2. Is the credit awarded with or without a letter 
grade? 

3. How does the credit grade relate to the col- 
lege s letter grade system? 

4. How much credit can be awarded an individual 
student? 

5. Can the credit enter into the students total col- 
lege credit requirement? 

6. Who actually has the authority to establish 
policy? 

I. Should students pay a fee for taking the exami- 
nations? 

8. Who is responsible for recording the credit? 

9. Who is responsible for storing the records used 
to generate the credit? 

to. How is transfer credit handled? 

I I, Are students allowed to enroll below their 
expected placement level for course credit? 

12. Who has the responsibility of notifying stu- 
dents of their examination performance? 

13. Who has the responsibility of publicizing the 
policies and procedures? 

14. Should examinations be used for placement, 
exemption, or both? 



An example of a set of policies and procedures 
established for the UIUC is presented in Appendix E. 
These policies and procedures were proposed by 
a five-person committee made up of (a) professor In 
Classics* (b) professor in Educational Psychology 
and the Director of the College of Education's 
Center for Instructional Research and Curriculum 
Evaluation* (c) associate dean of the College of En- 
gineering, (d) the Director of Admissions and Rec- 
ords, and (e) professor in Educational Psychology 
and Head of the Measurement and Research Divi- 
sion of the Office of Instructional Resources. This 
committee was appointed by the Vice Chancellor 
for Academic Affairs, who sought the advice of the 
Faculty Senate's Faculty Advisory Committee be- 
fore accepting and implementing the committees 
report, 

Figure 6.1 shows how current practices and poli- 
cies regarding placement and exemption can be 
classified for decision-making purposes. 
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Figure 6. r. Classification of current placernencand epcempcion policies, practices^ and procedures 
Ciirmit P rait ices 

Dipiirtment Coi/e^e 
Currifi i /{ (iminisim A dm in is tm 

Polii'iis NoHM Exummalhti ExamiNafioN 



U u / fi ily Tis t ing 
Office Adminisim 
Bxamifiation 



None 



Placement and exemption 
for particular courses 



Placement and exemption 
for all undergraduate 
courses 

Credit is awarded for 
CDursework exempted 



Students do not pay for 
placement exam i nations 



Students pay for exemp- 
tion examinations 



All examinations ccjordi- 
nated through a central 
office 



Each exaini nation is the 
responsibility of the spon 
soring department 
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Appendix A, 

Example of a Locally Developed 
Calculus Exemption Examination 



A Machematics Department faculty member at the 
i/IUC was given the responsibility of developing a 
calculus exemption examination, First, he examined 
the items of previous final examinations for the 
calculus course (Mathemadcs 120) and identified 
the major concepts in the textbook used for that 
course. With this information he was able to specify 
che essential concepts and level of terminal knowU 
edge required for the Mathematics 1 20 course. 

NeKti he constructed a test blueprint (see Fig- 
ure a,i), reflecting the content areas to be covered 
and the skills required, and devised 40 multiple- 
choice items. 

The faculty member and instructional resource 
representative then edited the 40 items and se- 
lected 24 items for the first draft of the examination. 
Items in che examination were ordered by perceived 
difficulty. The first eight items were judged to be the 
easiest and were placed so as to instill some confi- 
dence in the test takers, The next three items related 
eo a single graph, The remaining items were or- 
dered by perceived difficulty* 

The instructional resource representative in con- 
sultation with the faculty member prepared a plan 
for tvaluating the items and determining the reli- 
ability and validity of the examination (see reliability 
and validity discussion in Chapter 2). The plan basic- 
ally consisted of the following steps: 

[. For item analysis purposes,* a first draft of the 
examination will be given as an hour examination to 
one section of the Mathematics 130 course around 
rnid-semester The Mathematics 130 course is the 
second course in calculus and analytic geometry for 
which Mathematics 1 20 is a prerequisite. 

2, A revised form will be administered as an hour 

• Item analysis refers to the in-depth analysis of each item in an 
examination to dererniine (a) what proportions of the high- 
scoring and low-scoring students passed each item, and (b) what 
proporEion of aJi students taking the examination passed each 
item. 



examination to one section of the Mathematics 120 
course tiear the end of the sennesten 

3. To keep the students* motivation level high and 
consistent^ they are to be instructed that if they do 
well on the examination, it will replace their lowest 
hour exaniitiation score. 

4. A second revised form will be administered as 
an hour examination to three sections of Mathe- 
matics 1 20 two weeks before the end of the semes- 
ter. 

5. The students are to be instructed that if they do 
well on the examination, it will count in their final 
grade in the course. 

6. The instructors of the courses will have the re- 
sponsibility of administering the exemption tests. 

7. The instructional resource office will produce 
the test booklets and supply the answer sheets and 
pencils. 

8. Test security, disseminationj and collection of 
all test materials will be the responsibility of the 
course instructor. 

9. The instructional resource office will conduct 
all analyses of the test responses and prepare the 
results in a readable and interpretable form for 
presentation to the mathematics faculty member. 

10. The analyses will consist of (a) item analyses 
(see Chapter tj pp. 3-4, for references on test con» 
struction techniques) of the first draft, first revision, 
and second revision, and (b) a determination of the 
degree of relationship between the mathematics 
exemption test scores (second revision) and grades 
received in the Mathematics 120 course (see con- 
current validity discussion in Chapter 2). 

1 1. Validity correlation coefficient of at least .50 
is expected in order to arrive at meaningful decision 
scores. 

12. The instructional resource representative will 
provide a recommended set of decision scores based 
upon the course grade versus the exemption test 
score comparison. 
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£3. The mathematics department faculty member 
will prepare a parallel forni of the second revision 
of the exemption examination. 

Following are concrete examples of steps 2, 4^ 
9, I o, and I a. In step i , the first draft of the examina- 



Figure A, i . Test staEistics for 






the Mathematics 120 
Proficieney Examination, form K 
first and second revisions 


TesI StaliSlia 

First Second 
Revishu RevisiON 


Number of Testees 


- * 34 


By 


Number of Items. ....... 


. 30 


23 


Score Range .......... 


. . 0-23 


5-20 


Mean Score 


. 15^79 


12.84 


Standard DeviaEion ....... 




2,64 


Standard Error of Measurement. . 


2.26 


2.06 


Reliability Coefficient (KR-20) . . 


. 0,45 


0,39 



tion was administered in one section (N — 26) of the 
Mathematics 130 course. Item revisions were made 
— primarily on the basis of an item analysis. As a 
general rule* items that were too difficult for the 
Mathematics 130 students were simplified and items 
that were too easy were recained^ since it was as- 
sumed that the difficulty level would be higher for 
entering students than for the Mathematics 130 
students who had already completed Mathematics 
120. The major revisions were as follows: (a) the 
number of items was increased from 24 to 30 to im- 
prove reliability, (b) difficult items were limplified, 

(c) some items were divided into two separate items, 

(d) fewer items had the alternative "none of the 
above" as the correct response, (e) some items were 
eliminated as being too difficult, and (f ) some items 
were revised so that they were less complex and in- 
volved less algebraic manipulation while still retain- 



Figure A. 2. Scatterplot of score on Mathematics 1 20 Proficiency Examination 

vs. final grade in Mathematics 1 20 fall semester 1 972 

(N^89) 
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ing the original conceptual content. 

The revised form was adminiicered as an hour ex- 
amination to one section (N = 24) of Mathematics 
120 near the end of the fall, 1972 semester (step 
2). This fofnn was then revised again, and the num- 
ber of items was reduced to 25. The items of the re- 
vised test were reordered on the basis of difficulty 
leveL 

The second revised and shortened examination 
was adniinistered a$ an hour examination to three 
sections (jN — 89) of Mathematics lao two weeks 
before the end of the fall* 1972 semester (step 4), 

The test statistics for the first and second revi- 
sions that were presented and considered appear 
as examples in Figure A.i (step y). 

The correlation between the test score and grade 
in Mathematics 120 was . 565 and the distribution of 
grades plotted on the inatheniatics exemption test 
score base is presented in Figure A. 2 (step 10). 

Based upon the relationship between the final 
grade in Mathematics 120 and the test score, a deci- 
sion score of 13 wai selected (step 12) — students 
with a score of 1 3 or above were exeinpted from 
Mathematics 120 and received five semescer credit 
hours. This decision score was also used to place stu- 
dents planning to continue work in mathematics 
into the Mathematics 1 35 course. 
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Appendix C. 

Example of the Interpretation Information for the ipy^ 
Freshman Guidance Form 



Office of Instructional Resources Research Memorandum No. 157 

307 Engineering Hall 

333-3490 



Interpreting the ipj^ Freshman Gmdance Form^ 

All students planning to enroll at the University of IlUnoisatUrbana-Champaign in the fail of 1974 
should take a battery of tests administefed by the office of Testing and Scoring Services, Psychologi- 
cal Counseling Center, The results of these tests are reported on the Freshnian Guidance Form, one 
copy of which is mailed to the advisor and the other to the student if the examinations were taken 
during Spring Testing, 1974, 

The following is an explanation of this form from the tap down, A copy of the fonTi with sample 
data is appended to this memorandum (Figure C, r ). 

u The first line contains student idendfication, rank in high school senior class (i through 100), 
high school standing ( i through number of srudents in high school senior class) and high school 
Senior class si^e. 

a. Freshman Guidance EKaminations (FOE) scores and the corresponding College Deciles and 
All University Deciles are contained in the box at the top of the page/The deciles or tenths indicate 
where the students score stands relative to the distribution of fall 1973 freshmen scores. These 
deciles are printed as a series of identical single digits (0-9 ) and can be roughly grouped for evalua^ 
tion purposes as follows: 0-2 Poor, 3-6 Average, and 7-9 Good. For example, on the sample form the 
ACT/SAT English score is a6, with the student falling in the 8th decile for the college in which he is 
enrolled and the 8th decile for all freshmen enrolled in the University. 

Phase note: Scores 1 through 5, ACT/SAT are from the Test Battery of the American College Tesdng 
Program and College Board Scholastic Aptitude Test.^ Scores 6 through a, scat, are from the Coop^ 
erative School and College Ability Tests-'- 

L This memorandum was prepared by tht placement and proficiency staff" consisting of Richard Tares Nancy HM, and Don Heil. 

3. The ACT aptitude test battery consisting of four tests CEin be obtained ffOfn the Arnerican Coliege Testing Program, P.O. Buk 168, 

Iowa City, Iowa 5iJ40. 

S, The SAT and SCAT aptitude test batteries c<5ns!Sfitig of three tests mc\\ cm be obtained from Educational Testing Service, Pnnccinn, 
New Jersey 0814 J « 
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Score r o of the FGE scores appears as Expectancy of a or Better Grade on txhe studant's form 
and as Selection Index on the advisor s form. This is the only place where the two forms diflfer. The 
Selection Index is an estimate of the student's first semester gr^de point average (GPA i) based on 
his High School Percentile Rank and ACT Composite score. It is princed out as a rwo^digir number. 
For example, a 39 indicates an estimated GPA i of 3.9, 

The EKpectancy of a "C" or Better Grade is an estimate of the likelihood that the student would 
make a CPA i ofat least 3.0, This estimate is derived from the Sdection Index and is also princed 
out as a two-digit number. For example, an eKpectancy of 90 indicates that the student has approxi^ 
mately a yo percen t chance of obtaining a GPA i of at least 3 .0. 

3. Oi appearing at the lower right of the first box staridsfor discrepancy index. If an asterisk (*) 
appears here, the college deciles for High School Percentiie Rank and either the ACT Composite 
score or the SCAT Total score differ by three or more deciles. This asterisk should alert the advisor 
to the possibility that the student s measured ability and previous performance may not be 
congruent, 

4, Placement and Proficiency (P sc P) Information is provided on lines 1 1 through 22. 

a. P & P examination titles are printed in the first column. Only one examination is available in each 
area with the following exceptions: 

( I ) Biology - Four examinations (Biol 1 00, i o i , 1 1 o, and 1 1 1 ) are available for proficiency credit 
only. The examination(s) taken are printed directly to the right of 14 BIOL and 15 BIOL, 

(a) Foreign Language Two spaces are allocated (i 7-19 Md 30-22) for reporting examination 
scores. The examinations taken are printed above 17 READmc and 20 READING. 

b. Educational Opportunities Program (EOP) students are identified with a "50" computer printed 
to the right of r 7, below 1 6 CHEM, 

c. The column headed SCORE indicates the raw score in each test area for all but the French, German, 
Russian, and Spanish examinations which are reported as College Board CCEEB) standard score 
equivalents. 

d. The column headed U. ofL DECILE indicates the University decile corresponding to the score 
and may be interpreted in the same fashion as the deciles in the PGE portion of the form. 

e. The column headed H.S. Units reports the number of high school years the student spent in each 
test area. This appears as a two digit number with either a " 5" or a "o*' as the second digiL A 

"5 ' indicates 1/2 year, 

f. The column headed Expectancy of ''C' or Betkr in Cmrse#i ,^^,a)]cl 4^ Q 

bers expressing the percent chance of achieving a *'C" or better grade in each of the courses listed 
in the placement column. For example, the sample FGE and p * P Form indicates placement in 
Mathematics 1 1 2, i 14, or 1 1 8. This student has a 94 percent chance of receiving a *'C" or better 
grade in Mathematics 1 1 2, a 99 percent chance in Mathematics 1 14, and a 90 percent chance in 
Mathematics 1 18. A double asterisk (^*) in the expectancy column(s) indicates that data was not 
available to generate expectancies for that course. A question mark ( ?) in the expectancy column(s) 
indicates that the student s predicted grade for that course falls below the range of available data. 
This does not necessarily mean that the student would have a problem with the course, but does 
mdicate that his/her entering abilities as measured by the relevent FGE scores are lower than 



most of the students previously enrolled in that course. If more than three courses are princed in 
the Placement column the expectancies for only the first three will be printed. 
The column headed Report o/H, S. G rade specifies the estirnaited average high school grade in that 
sub ject for the number of years indicated in the S, Units cc^lumn. This estinnated average is 
provided by the student, 

h. The column headed Courses Proficienchd lists the course(s) and cofrespondiiig proficiency hours 
that the student has earned by examination. Only English^ biology^ and the foreign latiguages no^ 
offer proficiency hours based upon the locally administered p ^ P examinations given to entering 
freshmen, 

Phase note: If a student proficiencies fewer than i6 hours (e.g,, JOi and xoa) of a foreign language, 
proficiency credit is contingent on the cornpletion of the language course into which he placed^ 
that is, the course listed under Placement. 

i. The column headed Placement lists the courses the student should register for based upon his test 
scores and, in the case of foreign language, his high school units. The advisor can change place- 
ments only after obtaining permission from the appropriate department chairman. 

Please note: If Mathematics 135(1 20) is printed and conservative placement is advisable, place into 
Mathematics 1 20. If '*CHEM SEE MATH PRQ'' appears on the chemistry placement line or '*BlO SEE 
c::i-lEM PRQ" appears on the biology line, the student must verify with the chemistry or biology 
depar tmenc that he has taken enough mathematics or chemistry to handle the courses into which 
he may be placed. 

j. The column headed Creciit Status indicates whether a student is to receive credit for the course in 
which he is placed. "Y" for yes should appear for all course placements except Chemistry 100 
where *'N" for no could appear since credit in Chemistry 100 is determined by high school units 
and placement level. 

5. CJUEP InfofnHttion appears on lines 2 3 through 26. The first column contains the student's 
standardised scores and the second column contains the deciles corresponding to those scores. This 
decile indicates where the student's score stands relative to the discributicjn of scores obtained by LAS 
students in the norming sample. The Credit Granted box will contP^in the printed message Yes, No, 
or W (Waiver only). The last column contains the number of credit hours granted if the message is 
"Yes" or number of regional credit hours waived if the message is ''W/* 

6. On the last line of the form a *'Yes" will appear opposite Proficieiicy P & p if any proficiency 
hours have been granted and a "Yes" will appear opposite Credit CtEP if any credit hours have 
been granted. The line labeled Anth^fized and Approved by OIR" ^iU have the name L. M. Aleamofli 
printed on it and will constitute the required authorization for this record to be used by the Office of 
Admissions and Records to determine proficiency hours or CLEP credit hours for the student. Since 
duplicate credit will not be honored, the credit presented on the HGE and P & P Form is subject to 
review by the student's college before it is recorded. 

For complete information regarding the data provided in the Freshman Guidance Form please 
request the following memoranda from the Measurement and Research Division of the Office of 





Instructional Resources: 



I Freshman Guidance Examination Deciles and Grade Point Expectancies for Fall 1 974 Freshmen. 
Research Memorandum No. i 58. This paper contains tables shoeing the decile score equiva- 
lencs, means, Ms, and standard deviacions for che ACl/SAT, SCAT test batteries, HSPR, and the 
Selection Index for all freshmen entering the University. These data are also shown separately for 
the following colleges: Agriculture, Commerce and Business Adminiscration, Engineefing, Fine and 
Applied Arts, College of Liberal Arts and Sciences, Aviation and Physical Education. Also included 
are the expectancy tables for a gpa i at 3.0 or greater for all freshmen entering the University and 
for e3xh of the colleges listed above, with the exception of Aviation, 

2. Placement and Proficiency Examination (p & P) Deciles, Collegeievel Examination Program 
(CLEP) Deciles and Course Grade EKpectancies for Fall 1974 Freshmen. Research Memorandum 
No. f 59. This paper contains tables showing the decile score equivalents, means, Ns and standard 
deviations for the i 3 p p examinatic:)ns and the four CLEP General examinations. Also included are 
the course grade expectancies of or greater for all of the courses in the P & P system. A detailed 
description of the expectancy calculations is presented along with the regression equations used in 
their generation. 

3. Course Placement and Proficiency Scheme and CLEP Score Cutoffs for Fall 1974 Freshmen, 
Research Memorandum No. r 60. This paper presents a short description of the placement and 
proficiency system and the complete details of placement and proficiency score cutoffs and 
contingencies. 

4. Placement Statistics for Fall 1973 Ffeshmen, Research Memorandum No. i6i. This paper 
presents the P & P score cutoffs for 1 973 and the number of freshmen proficiencicd or placed for all 
of the courses in the P & P system. 

5. Foreign Language Standard Score and CLEP General Examination Score Equivalents for the Fall 
1 974- 1 97 5 Freshmen. Research Memorandum No. 150. 
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Appendix D. 

Proposal on LAS College Policy 

Concerning the CLEP Examinations 

and the General Education Exemption Program 



Department of the Classics 

2 17-333-1008 

University of Illinois March 6, i 972 

4072 Foreign Languages Building 
Urbana, Illinois 6 1 80 1 

Tn: The General Educadon Council and rhe Comrnittee on Placemenr and Proficiency of the 
College of Liberal Arts Sciences 

From: Richard X Scanlan, Chairman, Committee on Placement and Proficiency 

S//AyW/.' College Policy on the College Level EKamination Program 
and General EducatlDn Proficiency 

You will find on the attached chart the cut-off [decision] scores for the College Level Examination 
Program General Examinations established by the Committee on Placement and Proficiency and the 
General Education Council for waiver of the college distributional requirennentsand credit. These 
scores have been determined through the following process: 

1. General Examinations were given to those entering freshmen selected by their surnmer advisors. 
(September, 197 i) 

2. General Examinations were given to a large group of unselected freshmen> (September, 1971) 

3. An appropriate Examination was given to juniors who had completed specific distributional 
sequences. (January, 1972) 

4. The secures achieved on the CLEP General Examinations by the juniors were cornpared with ( i) 
the grades which they had received in the courses they had selected to complete the requirement, 
(2) the scores achieved by both groups of freshmen earlier in the fall, and (3) the national norms 
established by the CLEP program forccoUege sophomores. 

5. Cut-ofiF scores were established. 

You will note from the chart that the two committees have established a varying scale of recognition 
from three to six hours of credit according to performance on the test. A waiver of the distributional 
requirement will be granted upon achievement of the score necessary for three hours credit, It will 




probably be necessary to establish an LAS course for bookkeeping purposes to which thii *'generar' 
credit can be attached. 

The committees recommend that the CLEP General Examinations be adminlstefed by the Measure- 
ment and Research Division three times a year: at the beginning of each semester and of the summer 
session, A student may take an eKaniination in each of the four areas only once during a given year. 
After the first semester of the sophoriiore year, the exarninations can be taken for waiver only, with 
no credit allowed. Students will be charged S3.00 for each examination taken. 

We recommend chat the suninier advisors in 1972 and thereafter advise incoming freshmen as to 
the availability of rhe CLrp General EKaminations to be administered during the first week of the fall 
semester and which of the tests» if any, they should consider taking. For the other two test adminis- 
tratians during the year, we recoitiniend suitable publicity (e=g., a letter about the availability of the 
test'i to freshmen and sophornores in the college, advertisements in the Dcnly lllini, etc/) and 
[niaking] registration forms available in the college office. 

CLEP Data 

( Waiver of the distributional requirefnent is to be granted upon achieveirient by the student of the score 
ntct*s5ary for three hours credic) 

C/^ioff LormpONtiiNR Ptrcmiile Pemfttiie 





Scon 


G rue/e 


VoflFmh 


Nu 


Social S cie net' 










fV)r 6 hrs credit ............. 


............ 


A 


88 


84 


fat 3 hrs crudif 


. ^ ... ^ ^ ..... 4\ 


C + 


68 


70 


Hu iTianities 










for 6 hrs credit 


49 


A + 


B7 




for 3 hrs credic 


............ 39 


B 


66 


73 


Biology 










ftir () hrs credit, 


............ 




88 


95 

79 


for 3 hrs credit 


............ 28 




67 


Physical Science 










fcjr 6 hrs credic 


............ 


A 




88 


for 3 hrs credit. 


............ 2?^ 


C 




79 



1 , This column contains the raw score on the CLHP General EKaminaflun. Scores CJn Bioiogy and Physical Science appear 
sumewhat lower than the other two areas because they are subscores of a single test. 

2, This column indicates the level of ability comparable to a given cucoff score within the group of juniors who were 
tesreii. These data are not available on the biology test, 

3, This column reports the corresponding percentile rank of entering U of I freshmen at each leveL Data an the physical 
science tt*st are insuihcient for a precliction, 

4, This column indicates the percentile fank of each cutoff score conipared with a national norming sample of college 
sophomores. 
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Appendix E. 

Policy and Procedure Recommendations Regarding Placement 
and Proficiency Examinatioyis at the UIUC 



The Ad Hoc Cornmictee, in its review of (a) current 
piacemt^nt and prDficiency policy and procedures on 
the Urbana-Chanipaign campus of the ^ ' uversicy of 
Illinois and (b) che "Final Recornmendations of the 
Educational Policy Subcommiccee on Proficiency Ex- 
aminations" submitced in lytnS, recommends that 
greater uciUjation of placement and proficiency ex- 
aminations, especially proficiency examinations, 
should be encouraged at the campus and as a result 
greater educacional benefits could be rendered for 
the University community, especially students. The 
Committee recommends that the Vice Chancellor 
for Academic Affairs establish a central office to co- 
ordinate the placeinentand proficiency exarninations 
for the campus both for incoming undergraduate 
students and proficiency examinations for students 
after regis tratian, 

A. Po/ky Ueco??imen£latkjns 
RMommeNd^tian A i 

The Ad Hoc Comnnittee recommends that a central 
office be designated to coordinate proficiency and 
placement t*5Camination activities. Specific recom- 
mendations are as follows: 

(a) All acaclemic departments within the Univer- 
sity at Urbana-Charnpaign may cooperate with the 
designated tiflice which upon request of the depart- 
ments will assist in preparing or selecting* adminis- 
tering, and grading the examinations. Preparation of 
examinations to be used, permission for students io 
take such eKaminations, and grading of the examina^ 
tions would continue to be the responsibility of the 
individual department in which the interested stu- 
dent wished to take the examination. The results of 
the examinations would be reported to the central 
coordinatiofi office for record-keeping and research 
purposes. 

(b) The office vw^ould be responsible for cciordinat^ 
ing placement and proficiency examination programs 



on an All-Campus basis and for related proficiency 
programs such as the College Board tests, the Col- 
lege-Level Exarnination Program (CLEP) tests, ere, 

(c) The office would be responsible for the general 
administration of the proficiency program, process- 
ing of proficiency examination requests, and inform- 
ing the Office of Admissions and Records, colleges, 
and deparcments of all rest results. 

(d) A five-member advisory group would be ap- 
pointed by the Vice Chancellor for Academic Af- 
fairs to oversee the policies and procedures iniple- 
mented by the office, 

(e) The office and departments would be respon- 
sible for annual reviews of che tests and the inci- 
dences of their use in relation to the policy for pres- 
ent and potential use> The general results of such 
reviews would be reported and reviewed by the ad- 
visory committee. 

Recommendation A2 

The Ad Hoc Committee recommends that the final 
score of all proficiency examinations be recorded^ 
regardless of whether the result is "pass" or "fail/* 
Only grades of ''pass" should be recorded on che 
permanent student ledger, but a record of 'failures ' 
should be maintained in t,.e designated office to aid 
in future evaluaticjn and development of the profi- 
ciency program. 

RecojnmefidatioN A ^ 

The Ad Hoc Committee recommends that students 
be allowed to repeat a proficiency eKaminafion after 
having failed it previously provided that at least 
one semester has elapsed since the previous failure 
and more than one form of the examination is avail* 
able. 

RecotfimerHicitiori Ajf. 

The Ad Hoc Committee reconimends that a student 
who passes any forrn of a recognized proficiency ex- 



id 

EKLC 



51 

(14 



aminacion (Advance Placement Examination, Uni- 
versity oMiIinois ac Urbana-Chanipaign Proficiency 
Examination, etc.) be allowed the credit even though 
he failed that proficiency exaniination previously. 

Ricommendcition A f 

In testing for course-in-sequence placenient, com- 
bined placement and proficiency examinations 
should be used since the deciiion involving place- 
ment usually implies Sonne proficiency in the pre- 
ceding course(s); ej„ when a student is placed into 
Latin 103, it is assurned that he has demonstrated 
proficiency for Latin loiand 102. 

Recommendation Ad 

Available placement and proficiency examinations 
could be taken by transfer students who are ac- 
cepted for admission and used for guidance and 
placement at the University of Illinois at Urbana- 
Champaign. 

B. Procedure Recommmdations 
Recomniendcition Bi 

The Ad Hoc Conimittee recommends that the Vice 
Chancellor for Academic Aflfairs send a memo- 
randum to departmencs and colleges encoufaging 
them to develop and use placement and proficiency 
examinations (which may include the College Level 
Examination Progranri (CLRp) series or any other 
type of placenrient and proiiciency eKamination) and 
to work with the designated office for the coordina- 
tion and validation of such exaininations. Also, the 
memorandum should eniphasize the desirability of 
using the central coord ination ofTice in the area of 
such examinations. The results of the exaniinations 
should be channeled through the designated office 
for academic recprdingand other research purposes. 

RMonimendatioN B2 

The designated office shall develop procedures for 
the implementation of the following specific respon- 
sibilities: 

(a) Maintaining placernent and proficiency eK- 
amination records, 

(b) Reporting exaniination results to students, 
departments, colleges, and the Office of Admissions 
and Records. (In addition, scores on group place^ 
ment and proficiency emminations should be re- 



ported to the Psychological and Counseling Centerj 

(c) Research activities pertaining to the examina- 
dons, 

(d) Developing and publishing a calendar of place- 
ment and proficiency examinations to be given per- 
iodically. 

(e) Collecdng from and distribucing to all depart 
ments details of departmental requirements and 
other rules involving departmental proficiency ex- 
aminations. 

Recommendation Bj 

It is further recomniended that considerable pub- 
licity be given to the greater emphasis being placed 
on the adrnlnistracion of placement and proficiency 
examinations through the central designated office. 
Such publicity should be shared with all high school 
and community counselors in the State of Illinois, 

J, Thomas Hastings 

Richard T. Scanlan 

Jane Loeb 

Howard L, Wakeland 

Lawrence M. Aleamoni, Chairman 
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Appendix F. 

Glossary of Bask Terms of Measurement and Statistics 



Affei'iiii' lei tl: An individuars interest, attitudes, values, 
and developmunc of appreciations. 

Cmniiiit kitl: An individuars recall or recognition of 
knowledge and the development of intellectual abili- 
ties and skilU, 

Couiiirnnt vulidaUnu: A comparison of how well test 
scores match measures of contemporary criterion 
perforrnance. 

Cm tent validation: A determination of how well test 
items sample the areas of subject matter and the abili- 
ties which a course of instruction was designed to teach. 

Currdutiofi coefficieNt: A pure number, with values ranging 
from ^ 1 .00 to + 1 .00, that ind icaces to what extent c^vo 
measures are related. 

Criieriofi: A standard, norm, or jud^rnent used as a basis 
for quantitative and qualitative comparison. 

Decision for lU^tin^) score ; A nuinber which separates stu- 
dent scores which are satisfactoiy in terms of sotne pur- 
pose or criterion froni those which are not satisfac- 
tory. 

DiSpgrsif)N:^ha scatter, variabiJity, or spread of a distribu- 
tion of scores around some central value such as the 
mean; also referred to as vuriuhdity. 

Bmpirical erid€me:ThQ collection and analysis of data. 

Empirical validation: A com pari son of test scores with 
accurate criterion measures. 

EvtiiNution: A judgment of merit, sometinies based solely 
on measurenienrs such as those provided by test scores 
but more frequently involving the synthesis of vari()us 
measurennents, critical incidents, subjective impres- 
sions* and other kinds of evidence. 

Exempt ion: Excusing students from a degree requirement 
on the basis of demonstrated proficiency that may have 
becii arquired outside of the classroom. 

Experimtrttifi ni/idatioN: The use of trait-treatment inter- 
action prcKedures. 

Prague my distribidtion idiagraml: A tabulation of scores 
from high to low (or low to high) showing the number 
of students who obtain each score or group of scores; 
also referred to as a distribution of scores. 

hiomogeneity: The similarity of stud en Cs in a group or the 
items in a test. 

Um analysis: The proress of evaluating single test items 
by any one of several methods to determine how well a 
^iven test item discriminates among students differing 
in terms of some standard; then discrimination usually 



i n vo 1 ves d e te rrn i n i ng the item d ijfictdty and disirim i mat- 
ing power, 

Itm difficulty: The proportion of a specified group who 

answer a test item correctly. 
I discrimination: A measure of the abilicy of a test icem 

to diflFerentiate berween studenJs %vho are judged to be 

good in terms of some standard and those who are 

judged to be poor on the same standard. 
Kuder^RichcirdsoN form a las (KR- 20, KR-21}: efstimates of 

the reliability coeflScient of a single test frorn a single 

test administration. 
Logical I'a/idatioH: A jud|rTient of rhe appropriateness of 

the test in light of the instrucnional objectives of the 

tf)urSe, 

Mean: A measure of the average numerical value of a set 
of scores. 

Norms: Summarized (tabulated) statistics thar describe 
the test perforinance of reference groups of scudents of 
various ages or grades. 

Placement: The positioning of students at the optimal 
point in an instructional sequence ofi the basis of how 
much the student already knows about the subject. 

Proficiency: A measure of overall compecency in a par- 
ticular course or sequence of ctsurses. 

Raw score: The number first obtained in scoring a test, 
before any trarisfofmation is made ro a standard (or 
converted) score. 

Reliability: The consistency of a measure^ chat is, how 
consistent are students* scores from one time to an- 
other (assuming no additional learning, practice ef- 
fects, etc.). 

Reliability coefficient: A correlation coelBcient bet ween 
scores on two equivalent forms of a measure taken by 
the sarne group of students. 

Significant dijerence: A large enough difference between 
two corn pa fable statistics (e.g,, two means) computed 
from separate samples so that the probability that the 
difference occurred by chance is less than some spe- 
cified limit (e.g., a difference this large would occur 
by chance not more than 5 times in 100). 

Standard deviation: A measure of vaTiability, dispersion, 
or spread of a set of scores around their mean. 

Standard error of measurement fSENJ; An estirnace of the 
inaccuracy (amount of measurement urrof) in a stu^ 
dent's raw score. 

Standard score: A score derived from a raw score so that it 
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can be expressed on a uniform standard scak' wichout 
aicering its relatiunshjp to other scores in the discribu- 
cion. A simple type of standard score is the Z-score. 
which expresses each raw score as a positive or nega- 
tive deviation from the mean of all raw scores. 

Tniit-^redtment interadinn: Students who difTer on a par- 
ticular trait (attribute) measure will do better under 
different treatment conditions, 

Validtty; The accuracy of a measure, that is, to what ex- 
tent is the test measuring what it is supposed to xriea- 
sure. 

Validity cmjficivnt: A correjarif^n coellicient between 
sctjres on rwo jmeasures taken on the same group of 
individuals. 
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